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HIGH  SCHOOL  AND  UNIVERSITY  MATRICULATION  EXAMINATIONS  BOARD 

DEPARTMENTAL  EXAMINATIONS,  1940 


SOCIAL  STUDIES  3 


Time — 3  hours. 

Note — Candidates  should  read  the  following  directions  carefully:  Answer  PART  A; 
ALL  questions  of  PART  B;  and  ANY  FIVE  questions  of  PART  C. 

The  passing  mark  is  not  necessarily  fifty  per  cent  of  the  total  score  of  the 
paper. 

Question  2  should  be  answered  on  the  accompanying  outline  map  which 
should  be  returned  with  your  answer  paper. 


Values 


PART  A 

(To  be  answered  by  all  Candidates) 


25  1.  Write  an  essay  of  about  five  hundred  words  on  one  of  the  following  sub¬ 

jects  : 

(a)  The  Role  of  Canada  in  Anglo-American  Relations. 

lb)  Factors  which  foster  or  obstruct  Canadian  national  unity. 

(c)  Provision  and  Support  of  Social  Services  in  Alberta. 
id)  The  Co-operative  Movement  in  the  Scandinavian  Countries. 


PART  B 

(To  be  answered  by  all  Candidates) 


On  the  accompanying  map  of  Europe  and  adjacent  areas  in  1914 

8  (a)  Draw  (using  a  broken  line)  the  boundaries  of  the  following  states 

after  the  signing  of  the  Peace  Treaties :  Poland ;  Germany ;  Rumania ; 
Czechoslovakia;  Yugoslavia;  Austria;  Soviet  Union;  Hungary. 

1  (b)  Draw  (using  a  dotted  line)  the  boundaries  of  Greater  Germany  in 

December,  1939. 

8  (c)  Indicate  approximately  the  position  of  the  following:  Sudetenland 

(mark  “Su”) ;  Danzig  (mark  “Dz”) ;  Munich  (mark  “Mu”)  ;  Ankara 
(mark  “Ak”) ;  Tunisia  (mark  “Tu”) ;  Passchendaele  (mark  “Ps”) ; 
Murmansk  (mark  “Mm”) ;  Karelian  Isthmus  (mark  “Ki”) ;  Eire; 
Heligoland  (mark  “Hd”) ;  Scapa  Flow  (mark  “Sf”) ;  Bessarabia 
(mark  “Ba”) ;  Geneva  (mark  “Ga”) ;  Sylt;  Tallinn  (mark  “Tn”) ; 
Dardanelles  (mark  “Ds”). 

8  3.  What  are — 

The  Holy  See;  anti-Semitism;  Monroe  Doctrine;  the  “Open  Door”  policy  in 
China;  most-favoured-nation  treaty;  economic  sanctions;  the  “Comintern”; 
mandates? 

6  4.  (a)  Select  six  of  the  following  treaties.  For  each  treaty  selected,  give  the 

names  of  the  governments  signing  it. 

Lausanne 

Washington  Five-Power  Treaty 

Neuilly 

Locarno 

Trianon 

Versailles 

The  Concordat  of  1929 

St.  Germain 

Brest-Litovsk 

Riga 

Rapallo 
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8  (b)  Each  of  the  following  terms  belonged  to  one  of  the  treaties  named  in 

(а) .  For  each  of  these  terms,  write  the  name  of  the  treaty  of  which 

it  was  a  part. 

(1)  Russia  evacuated  Finland,  Latvia,  Esthonia  and  the  Aaland 
Islands . 

(2)  Alsace-Lorraine  was  ceded  to  France. 

(3 )  The  signatory  powers  guaranteed  the  Belgo-German  and  Franco- 
German  frontiers  and  agreed  to  the  demilitarization  of  the  Rhine¬ 
land  . 

(4)  South  Tyrol,  Trent,  Trieste  were  ceded  to  Italy. 

(5)  Slovakia  became  part  of  the  new  republic  of  Czechoslovakia . 

(б)  A  large  tract  of  White  Russia  was  included  within  the  boundaries 
of  Poland . 

(7)  The  union  of  Austria  and  Germany  was  expressly  forbidden. 

(8)  Greece  was  awarded  western  Thrace  and  Bulgaria  lost  her  Aegean 
coast-line. 
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5.  Two  lists  are  given  below :  one,  containing  the  names  of  leading  personal¬ 
ities  ;  the  other  containing  descriptions.  Copy  the  letter  that  corresponds 
to  each  name  and  write  after  it  the  appropriate  description.  For  example, 
Count  Ciano  is  Italian  Foreign  Minister;  hence,  write  “(a)  Italian 
Foreign  Minister”. 

Leading  Personalities  Description 


(a) 

Count  Ciano  (example) 

1. 

(h) 

Sir  Eric  Drummond 

2. 

(c) 

Sir  Arthur  Currie 

3. 

( d ) 

General  Cardenas 

4. 

(«) 

Thomas  Masaryk 

5. 

(/) 

Stresemann 

(fif) 

Hindenburg 

6. 

7. 

W 

Maurice  Gamelin 

8. 

(») 

Eamon  de  Valera 

9. 

10. 

(?) 

Leon  Trotsky 

(fc) 

Admiral  Horthy 

11. 

(0 

Virginio  Gay  da 

12. 

13. 

(to)  Sir  Robert  Borden 

(«) 

Chiang  Kai-Shek 

14. 

(o) 

Ernest  Lapointe 

15. 

(p) 

Dr.  Hjalmar  Schacht 

16. 

(7) 

Viscount  Halifax 

17. 

(r) 

Adelard  Godbout 

18. 

19. 

(s) 

Edouard  Herriot 

First  Secretary-General  of  League  of 
Nations. 

Commander  of  Canadian  Forces  in 
1918. 

Generalissimo  of  the  Chinese  National 
Army. 

President  of  the  Dail  and  Premier  of 
Eire. 

Canada’s  Prime  Minister  during  First 
Great  War. 

Canadian  Minister  of  Justice. 
President  of  the  Republic  of  Mexico. 
German  Economic  Adviser. 

Leading  Italian  Newspaper  Editor. 
Russian  revolutionary  leader  now 
exiled  in  Mexico. 

President  of  former  Czechoslovak 
republic. 

Regent  of  Hungary. 

Foreign  Minister  of  Germany 
(1923-29). 

German  Military  leader  and 
chancellor. 

French  political  leader,  former 
premier  and  foreign  minister. 

Italian  Foreign  Minister  (example). 
Present  British  Foreign  Secretary. 
Premier  of  Quebec  Province. 
Commander-in-Chief  of  Allied  Land 
Forces. 


PART  C 

NOTE — Answer  any  FIVE  questions. 

5  6.  (a)  Mention  five  of  President  Wilson’s  Fourteen  Points. 

3  (b)  Name  three  disputes  in  which  the  intervention  of  the  League  of  Na¬ 

tions  may  be  said  to  have  averted  open  warfare. 

4  (c)  Offer  two  reasons  for  the  apparent  failure  of  the  League  to  halt: 

(1)  the  Japanese  invasion  of  Manchuria;  and  (2)  the  Italian  occupa¬ 
tion  of  Abyssinia. 

12  7.  In  what  various  ways,  since  1919,  has  France  in  her  foreign  policy  sought 

to  achieve  national  security? 

12  8.  Account  for  the  failure  of  the  German  Republic  of  1919-1933. 
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12  9.  Why  has  Italy  been  one  of  the  discontented  and  “revisionist”  powers  since 

1919? 

10.  Describe  briefly — 

4  (a)  the  main  industries  of  the  Canadian  (Pre-Cambrian)  Shield; 

4  ( b )  the  work  of  the  Wheat  Pools  in  Western  Canada; 

4  (c)  problems  arising  out  of  the  land  settlement  policies  in  the  Prairie 

Provinces. 


11.  Discuss  the  attitude  of  the  United  States  since  1919  to — 
6  (a)  The  League  of  Nations; 

6  (6)  the  Sino- Japanese  conflict  in  the  Far  East. 


6  12.  (a)  What  weaknesses  are  attributed  to  democratic  government  by  critics 

in  the  totalitarian  states? 

6  ( b )  Make  a  statement  of  the  merits  of  democratic  government  in  answer 

to  the  arguments  of  these  critics. 
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13.  (a)  “The  precarious  world  situation  is  making  the  members  of  the  British 
Commonwealth  more  aware  of  their  interdependence.  The  Dominions, 
which  have  already  gained  legislative  independence,  are  coming  to 
rely  on  the  imperial  fellowship  in  a  world  which  can  guarantee  them 
neither  political  nor  economic  security.  For  a  large  proportion  of 
the  citizens  of  the  Dominions,  moreover,  the  imperial  association  is  no 
longer  regarded  by  them  as  a  limitation  of  their  political  pride  or 
national  self-respect.  Their  culture,  ideals,  and  political  traditions 
assume  larger  stature  and  significance  for  them  because  they  are 
shared  with  the  Commonwealth.”  Adapted  from  Page  115,  British 
Empire  Commonwealth  (Trotter). 

(6)  “There  is  ample  room  in  this  Commonwealth  for  many  varieties  of  de¬ 
mocracy.  We  do  not  know  what  the  future  will  bring.  All  we  can 
safely  say  is  that  neither  we  nor  our  children  are  likely  to  accept,  just 
as  our  fathers  refused  to  accept,  any  system  of  government  which 
subordinates  the  individual  to  the  state.”  Adapted  from  Page  238, 
The  British  Commonwealth  and  the  Future  (edited  by  Hodson). 

(c)  “During  the  period  when  the  Dominions  were  developing  into  auton¬ 
omous  states  it  was  natural  to  think  of  them  as  a  group  and  of  the 
central  problem  of  the  Commonwealth  as  that  of  adjusting  the  con¬ 
stitutional  relations  of  the  Dominions  with  Great  Britain.  It  was  also 
natural  to  discuss  that  problem  in  terms  of  the  formal  and  historic 
unity  of  the  Commonwealth,  with  the  result  that  possibly  undue 
emphasis  came  to  be  laid  on  the  centrifugal  character  of  recent  de¬ 
velopments.  The  problem  now  is  to  attain  the  maximum  of  mutually 
advantageous  co-operation  among  the  various  equal  nations  of  the 
Commonwealth.”  Adapted  from  Page  7,  The  British  Commomvealth 
and  the  Future  (edited  by  Hodson). 

(d)  “What  the  British  Commonwealth  is  searching  for  now  is  a  new  defini¬ 
tion  of  its  own  purpose,  which  will  be  valid  for  its  nationally  autono¬ 
mous  members  under  modern  world  conditions.” 


State  in  your  own  words  the  ideas  of  the  four  foregoing  extracts. 
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GEAPT2K  I 


TEL  ImPOKTAEOE  OS’  LEASERS  I2ET 
IE  EDUCATIOE. 

Long  before  education  had  become  the  formalized 
•and  bookish  procedure  that  we  of  today  so  often  delight 
to  spell  with  a  capital  letter,  there  was  a  very  definite 
attempt  to  measure  the  achievement  of  youth  in  a  few  sel- 
•  acted  fields  of  endeavour.  This  attempt  at  measurement 
was  always,  indeed,  harshly  effective,  and,  in  a  crude  way, 
quite  efficient. 

The  youth  of  ancient  Persia  was  called  upon  to 
pass  a  severe  test  of  his  skill  in  the  use  of  rein  and 
b ow  before  he  was  deemed  worthy  of  a  place  upon  the  field 
of  battle.  for  the  youth  of  ancient  Sparta  life  was 
almost  one  continuous  test  up  to  that  great  day  the  ephors 
declared  him  worthy  to  be  enrolled  among  the  defenders  of 
the  Gity.  And  who  shall  say  what  tests  of  skill  and  cour¬ 
age  were  taken  and  ” passed”  by  that  unknown  Homan  who 
carried  the  banner  of  the  Tenth  Legion  to  the  shores  of 
Britain?  Indeed,  our  own  young  Indian  of  the  plains  must 
perforce  demonstrate  to  his  chief  his  ability  in  the  various 
skills  necessary  to  the  well-being  of  the  tribe  before  he 
was  awarded  the  status  of  manhood. 
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Always ,  then,  sane  attempt  at  measurement  lias 
accompanied  the  process  uf  education,  whether  that  educ¬ 
ation  was  the  mere  acquisition  of  a  manual  shill,  or  the 
more  refined  process  of  mental  development.  In  our  own 
day  the  youthful  "hid  you  pass?'’  has  become  the  most 
meaningful  idiom  of  the  language.  Small  wonder,  too, 
for  upon  the  answer  to  this  question  depends,  in  turn, 
so  many  of  the  answers  to  youth's  problems  that  society 
has  set  aside  for  each  of  us  a  good  round  decade  to  find 
the  all-important  answer  to  it. 

Today  that  answer  seers  to  be  more  important 
than  ever.  forms  and  more  forms- -forms  from  the  army, 
forms  fran  the  air  force,  forms  from  the  navy--daily  find 
their  way  to  the  teacher's  desk  via  war-eonsei ous  youth, 
and  always  on  every  form  is  a  social  place  reserved  for 
the  answer  to  that  all-important  question.  That  answer, 
indeed,  we  knew  to  be  important  a  generation  ago  when 
youth  was  on  the  march.  How  much  more  important  it  is 
today  when  youth  is  on  the  wing? 

Though  education  of  every  sort  has  always  implied 
some  attempt  to  test  the  results  of  achievement  it  is  only 
in  our  own  gem  rati  on  that  it  has  occurred  to  educi  tors 
that  perhaps  the  test  itself  would  be  the  better  for  a 
little  testing.  Herbart,  a  century  ago,  intimated  that 
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testing  should  be  an  integral  part  of  the  educative 
process,  but  by  and  large  even  the  "greats"  in  the 
history  of  education  were  too  busy  proving  the  need 
for  education  and  its  possibilities  to  bother  much 
about  measuring  its  results. 

Only  after  the  advent  of  compulsory  education 
did  the  need  of  standardized  measurement  become  appar¬ 
ent.  About  the  first  decade  of  this  centpxy  the 
democratic  taxpa ye r- - tha t  unsung  hero  of  progress 
without  end — began  to  feel  that  if  he  had  to  pay  for 
education  he  should  be  able  to  find  out  how  much  of  it 
he  was  gettirg  for  his  money.  Hot  yet  had  he  begun  to 
worry  about  what  scrt  of  education,  iha t  was  a  business 

for  the  schoolmaster  to  worry  about.  At  any  rate  it 
was  not  until  as  late  as  the  year  1907  that  we  find 
educators^  placing  some  special  emphasis  upon  testing 
programs.  The  new  idea  followed  the  rugged  road  of 
all  new  ideas  (but  faster  than  in  Galileo Ts  time) and 
immediately  subsequent  attempts  in  the  sane  direction 
met  such  stiff  opposition  from  the  powers  that  be  that 
the  whole  movement  was  threatened  with  extinction. 

Then  came  the  war.  American  army  officials  caught 

1w.L.fhDnnaike.,,The  Elimination  of  Pupils  from  School." 

A  report  prepared  for  the  United  States  Bureau  of 

Educe  tion . 
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on  to  the  idea  that  certain  skills  and  qualities  were 
better  tested  in  a  recruiting  office  than  in  a  trench 
of  No  Manfs  Land.  One  might  almost  say  that  once 
the  "measurement  idea"  had  won  the  favourable  notice 
of  the  American  army  the  whole  movement  was  due  for  a 
fair  trial. 

Indeed  there  are  those  who  claim  that  the 
"measurement  movement"  in  recent  years  has  been  over¬ 
tried:  that  too  much  was  expected  of  it  in  the  first 
place;  that  it  overemphasizes  certain  non-essentials 
of  education  to  the  very  great  detriment  of  certain 
fundamental  values;  and  that  educational  achievement 
is  of  its  very  nature  incapable  of  mathematical  des¬ 
cription.  The  writer  has  on  more  than  one  occasion 
heard  famous  educationists  refer  to  "the  measurement 
people"  in  a  tone  that  would  do  justice  to  Hitler  in 
referring  to  the  Jews. 

These  criticisms  may  have  some  validity.  At 
the  same  time  a  few  basic  propositions  may  be  set  down 
for  our  guidance,  which,  because  of  their  almost  uni¬ 
versal  acceptance  may  be  regarded  as  axioms.  They  are 
these: 

1.  That  if  there  be  such  a  thing  as  educational 
achievement  it  must  exist  in  some  measureable  amount. 
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2.  That  it  is  the  business  of  the  educator  to 
measure  it. 

3.  That  the  measure  used  by  the  educator  should 
itself  be  submitted  to  analysis  with  a  view  to  its 
continual  improvement,  and; 

4.  That  measurement  in  education  should  conform 
in  general  to  the  objectives  of  education  as  a  whole 
and  specifically  to  those  of  the  school  subject  being 
measured.^ 

In  our  own  province  in  the  last  few  years 
there  has  been  great  activity  in  the  field  of  education. 
Gourses  have  been  revised,  new  objectives  emphasized, 
course-content  has  been  broadened  to  meet  the  needs  of 
the  non-academic  student.  In  all  this  welter  of  acti¬ 
vity  no  subject  has  been  subjected  to  more  reform  than 
our  History  course.  It  has  been  bisected,  relabelled, 
and  revised  in  turn,  till  from  the  cocoon  of  "History" 
there  has  emerged  full-blown  the  new  Social  Studies — 

0L- 

worm,  butterfly,  and  best — or  at  least  the’^ete  noir" 
of  scores  of  teachers  from  Whisky  Gap  to  Grande  Prairie. 
Indeed,  "What  are  you  doing  in  Social  Studies?"  would 
serve  as  a  highly  reliable  password  to  any  teachers’ 
meeting,  if  password  were  needed. 


■^Test 


s  and  Measurements,  Smith  &  Wright,  p.6. 
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We  may  safely  assume  that  as  long  as  formal 
courses  are  taught  in  our  secondary  schools,  testing 
will  continue  to  be  a  matter  of  prime  importance  to 
all  who  are  concerned  with  our  educational  program. 

The  investigation  which  follows  is  an  attempt 
to  evaluate  the  efficiency  of  the  Social  Studies  3 
paper  of  1940  as  a  measuring  device.  It  was  felt 
that  in  view  of  the  fact  that  this  was  the  first 
examination  set  by  the  Department  of  Education  on 
the  new  course  in  the  Social  Studies  of  Grade  III 
any  number  of  interesting  and  useful  facts  might  be 
revealed  by  such  a  study.  It  was  hoped,  too,  that 
if  the  study  were  adequately  prepared  some  useful 
suggestions  for  improvement  might  possibly  result. 
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CHAPTER  II 


PRELIMINARY"  STEPS 

Permission  was  obtained,  from  the  Department 
of  Education  to  go  over  the  records  of  the  students 
who  had  written  the  Social  Studies  3  examination  in 
June  of  1940.  At  the  suggestion  of  Hiss  Grant,  head 
of  the  Examinations  Branch,  it  was  decided  to  select 
a  number  of  schools  that  it  was  hoped  would  prove 
fairly  representative  of  all  the  schools  of  the 
Province.  Thirty  one  schools  were  selected,  as 
follows : 

Large  City  Public  Schools 

Edmonton  -  2 

ualgary  -  2 

City  Separate  Schools 

Edmonton  -  E 

Calgary  -  2 

Smal  1  e r  T owns  ( 1 500- 1 5 000  ) 


northern  Alberta  2 
Southern  Alberta  2 

One  Lutheran  school  was  chosen.  The  smaller 
towns  (1500-3000)  were  chosen  to  represent  districts 
where  one  teacher  teaches  Social  Studies  and  perhaps 
two  or  three  other  subjects. 
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The  remainder  of  the  cases  were  chosen  from 
small  schools  scattered  throughout  the  Province.  In 
these  schools  Social  Studies  3  is  taught  by  a  teacher 
wii o  teaches  about  one-half  the  courses  offered,  or  by 
a  teacher  who  carries  the  whole  teaching  load  alone. 

Prom  each  of  the  large  city  schools,  both  public 
and  separate,  twenty  five  eases  were  chosen.  From  the 
smaller  towns  from  ten  to  fifteen  cases  were  chosen. 

From  the  one- teacher  schools  five  cases  were  chosen, 
or  as  nearly  five  as  the  total  number  of  candidates 
for  that  school  allowed. 

in  the  case  of  the  large  city  schools  every 
fourth  paper  was  chosen.  In  the  towns  every  second 
paper  was  chosen.  In  the  case  of  the  smaller  schools, 
of  course,  the  five  cases  took  every  paper.  The 
sampling,  too,  was  conditioned  by  two  other  circurn- 
stanches  that  1  shall  mention.  My  data  on  each 
student  include  the  following: 

1.  Social  Studies  mark Wt  in  Grade  Ik. 

2.  ite commended  Social  Studies  mark  in  Grade  X. 

3.  Hecommended  Social  Studies  Mark  in  Grade  XI. 

4.  Social  Studies  Haw  Score  in  Grade  XII. 

5.  English  Score  on  Social  Studies  Paper  in 
Grade  XII. 

6.  Transmuted  score  in  Social  Studies  of  Grade  XII. 

7.  Uet  Score  in  Social  Studies  of  Grade  XII. 

8.  I.Q. 

9.  The  category  of  each  student. 


. 
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In  1940  a  large  number  of  students  were 
finishing  up  under  the  old  course.  For  these  students 
the  data  I  wished  to  have  were  not  available.  These 
’Old  Course’  students  were  not  graded  into  the  cate¬ 
gories  A,  B  and  C,  and  for  the  most  part  their  records 
contained  no  recommended  marks  in  the  Social  Studies. 

The  other  circumstance  affecting  my  sampling 
was  that* it  v/as  hoped  some  useful  information  might 
be  gathered  from  a  consideration  of.feach  of  the  three 
categories  in  their  respective  groups  it  was  necessary 
to  control  my  selection  so  that  some  reasonable  number 
from  each  of  these  three  groups  might  be  chosen.  Espec 
ially  v/as  this  so  in  the  case  of  the  C’s  where  strict 
control  was  necessary  to  find  the  thirty-six  cases 
recorded. 

It  was  felt  that  the  schools  chosen  for  this 
study  offered  a  fairly  representative  sampling  of  the 
Social  Studies  results  throughout  the  whole  Province. 

At  least  I  believe  that  the  schools  chosen  represent 
every  type  of  school  we  have  in  the  Province. 

The  Social  Studies  3  examination  of  June,  1940, 
was  written  by  4312  students.  From  these  and  by  the 
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method  I  have  indicated,  315  cases,  or  7.3  per  cent  of 
the  whole  were  chosen.  The  result  was  175  A’s,  94  Bfs, 
and  36  C’s.  I  have  assumed  here  that  the  reader  is 
familiar  with  the  Alberta  system  of  grading  students 
in  categories  on  leaving  the  Intermediate  School,  but 
some  further  information  may  not  be  amiss.  On  leaving 
the  Intermediate  School  (Orade  IX),  the  Department  of 
Education  places  each  student  irloone  of  these  three 
categories,  nA" ,  "B" ,  or  nC".  An  nATT  student  is 

awarded  unconditional  promotion  and  is  free  to  plan  his 
High  School  course  as  he  sees  fit,  subject,  of  course, 
to  the  restrictions  of  the  official  regulations.  The 
"BTt  student  is  awarded  a  conditional  promotion  and  in 
his  first  year  of  High  School  is  restricted  in  his 
choice  of  academic  subjects.  The  UC"  student  is  still 
further  restricted,  and  is  advised  to  take  as  many  of 
the  non-academic  options  as  the  regulations  allow. 

The  data  having  been  thus  selected,  the  next 
problem  was  to  fix  upon  a  technique  that  would  prove 
adequate  for  analyzing  the  test  results  of  the  315 
cases.  Techniques  suitable  for  handling  data  repres¬ 
ented  by  Grade  IX,  X  and  XI  examination  scores  were, 
of  course,  readily  available.  They  are  known  to  all 
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students  of  modern  texts  on  the  science  of  education. 

Any  number  of  techniques  were  available  for  original 
investigations  that  involve  control  groups,  alternative 
forms  of  the  same  test,  and  the  various  procedures  of 
standardization.  To  find  a  technique  for  analyzing  the 
individual  items  of  the  test  paper  involved  a  more 
difficult  search.  In  this  case  the  nature  of  the  inves¬ 
tigation  limited  me  to  the  restricted  data  at  hand. 

There  was  no  possibility  of  securing  a  control  group 
for  the  purpose  of  checking  either  the  validity  or 
reliability  of  the  paper.  None  of  the  usual  procedures 
for  test  analysis  would  apply  where  the  data  were  complete 
before  the  investigation  was  begun. 

A  further  obstacle  to  the  use  of  the  better 
known  procedures  for  test  analyses  was  the  fact  that  all 
such  techniques  so  far  developed  were  designed  for  the 
analysis  of  objective  tests.  This  test  in  Social  Studies 
3  is ,  in  the  main,  of  the  essay  type,  and  all  efforts  at 
adaptation  of  the  suggested  procedures  proved  futile. 

It  was  finally  decided  that  the  test-analysis 
used  by  Dr.  Wesley  in  ''Teaching  the  Social  Studies” 
could  be  modified  and  adapted  to  the  purposes  of  this 
study.  It  works  as  follows: 
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1.  It  is  based  on  the  assumption  that  the  pur¬ 
pose  of  a  test  is  to  separate  thowe  who  know  from 
those  who  do  not  know. 

2.  When  we  discover  how  well  or  how  poorly  any 
test  item  performs  this  funcation  we  have  "a  measure 
of  its  goodness.” 

For  instance,  suppose  that  from  the  test  we 
are  considering-  we  select  item  5b, (Who  is  Sir  Eric 
Drummond?).  Our  315  cases  will  be  divided  into  three 
groups.  Best,  Middle,  and  Poorest.  To  make  this  div¬ 
ision  we  place  the  answer  papers  in  order  of  their  raw 
score  beginning  with  the  highest  score  and  descending 
to  the  lowest  score  made  on  the  test.  Then  we  count 
down  until  we  have  one-third  of  the  total  number,  or 
105  answer  papers.  This  is  the  "Best  Third"  of  our 
315  cases.  The  next  105  papers  are  the  "Middle  Third," 
and  the  lowest  105  cases  are  the  "Poorest  Third."  When 
we  have  compiled  the  scores  made  on  item  5b  we  can  set 
down  our  tabulation  as  follows: 

Item  Number  Correct  Percentage  Correct^- 

index  of 

Best  Middle  Poorest  Best  Middle  Poorest  Discrim- 

ination 

5  b  67  53  22  64 %  50 %  21 %  43 


1  105  cases  in  each  group. 
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Tiie  difference  between  the  percentage  correct 
in  tile  "Best”  group  and  the  percentage  correct  in  the 
"Poorest”  group  gives  us  the  index  of  discrimination 
and  tells  how  efficiently  the  item  functioned  to  dis¬ 
criminate  between  those  students  who  know  their  Social 
Studies  3  course  and  those  who  do  not.  Dr.  '.fesley  rs 
chapter  on  test  analyst s  from  the  book  I  have  quoted 
above  would  describe  this  as  "a  fairly  good  item," 

Item  5$  on  our  Social  Studies  3  paper  (Who 
is  Ghiang  Kai  Chek? ) ,  was  answered  as  follows: 


item 

Best 

Middle 

Poorest 

I.D 

5j 

74  $ 

CO 

GO 

91  f0 

-17 

This  item  was  known  better  by  the  "Poorest" 
third  than  by  the  "Best"  third,  and  so  in  no  way 
serves  to  mark  off  the  "sheep"  from  the  "goats," 
Since  it  does  nut  serve  the  purpose  a  test  item  is 
sup  used  to  serve  it  may  be  described  as  a  useless 


item, 


Ci-IA.PT],.-,  III. 


THE  INDEX  OF  DISCKIMIHATICH. 

Before  submitting  to  trie  reader  the  tables 
which  follow,  viz..  Table  1  and  Table  1(a),  some 
further  explanation  may  prove  useful.  I  hove  suggested 
in  Chapter  II  that  the  procedure  followed  in  arriving 
at  the  index  of  discrimination  was  originally  devised 
for  the  analysis  of  objective  test  items.  To  adapt  it 
to  my  purpose  it  was  assumed  that  our  essay  type 
questions,  for  the  purposes  of  marking,  are  broken 
up  in  :o  a  definite  number  of  "point s."  In  fact  I  may 
say  that  my  own  experience  as  a  "marker ,f  may  be  re¬ 
called  as  authority  for  the  claim  that  this  assumption 
is  correct.  A  "marker1*  scoring  a  question  vtforth 
twelve  marks  will,  in  a  certain  type  of  question 
look  for  twelve  points,  worth  one  each,  or  he  may 
look  for  six  points  and  award  each  one  two  marks,  or 
four  points  anu.  give  each  one  three  marks,  and  so  on. 

My  modification,  then,  is  that  I  have  assumed 
each  such  "point”  to  be  n  objective  item.  The  number 
of  marks  given  such  a  "point"  in  no  way  invalidates 
the  relative  percentage  scores,  or  the  index  of  dis¬ 
crimination  based  upon  them. 
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i  may  further  explain  that  the  significant 
table  here  is  number  1(a).  Space  demands  that  it  be 
given  a  separate  page.  Table  1  is  not  essential  to 
an  understanding  of  Table  1(a),  bit  it  was  thought 
best  to  incluae  it  in  order  to  show  how  the  percent¬ 
ages  in  Table  1(a)  were  derived.  It  is  read  as  follows 
Item  l(alfo  was  answered  by  28  students  from  the 
"Best  Third."  They  made  448  marks  (collective.) 
Highest  possible  collective  marks: 700.  The  percentage 
correct  is  448/700,  or,  as  we  find  on  item  1(a)  of 
Table  1(A),  64  per  cent.  In  the"MI&dle  Third"  this 
item  was  answered  by  £4  students.  The  collective  mark 
it  actually  earned  is  596.  The  highest  possible 
collective  mark  is  750.  Turning  to  Table  LA  we  find 
the  corresponding  percentage  to  be  53  per  cent.  By  the 
same  reading  the  "Poorest  Third"  has  a  percentage  score 
of  £8  per  cent.  The  difference  between  64  (percentage 
score  of  "Best")  and  38  (percentage  score  of "Poorest" ) 
gives  us  26,  our  index  of  discrimination. 

The  data  of  t  le  "Middle  Third"  prove  helpful 
in  estimating  the  efficiency  of  certain  items  as  may 
be  seen  from  items  5(i)  and  5(5),  as  also  in  item  1(d) 
in  Table  IA.  The  d  ta  in  this  group  are  not  necessary 
in  rr  ving  at  the  index  of  discrimination. 
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Table  1 
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OF  5ACH  TBST  I  Till 


Best  Third _ Middle  Thir d  ’  Poore sT  Third. 


ho. 

pPoss- 

ho. 

Poss- 

ho. 

Poss- 

Ans- 

noil 

.ible 

Ans- 

Coll. 

ible 

Ans- 

Coll. 

ible 

I  tern 

^ ere  a 

Mark 

Harks 

werei 

d  Mark 

Marks 

were 

d.IIark 

Marks 

la 

£8 

448 

700 

54 

396 

750 

31 

295 

7  76 

b 

29 

498 

725 

54 

435 

800 

27 

287 

675 

c 

1 

15 

25 

5 

56 

125 

8 

64 

200 

d 

48 

6£8 

1200 

53 

475 

825 

40 

423 

1000 

Ila 

105 

441 

840 

105 

508 

840 

105 

165 

840 

b 

105 

71 

105 

105 

46 

105 

105 

32 

105 

c 

105 

45£ 

840 

105 

345 

840 

106 

230 

848 

ilia 

105 

44 

105 

10  5 

26 

105 

106 

21 

106 

b 

105 

89 

105 

105 

59 

105 

106 

46 

106 

c 

105 

95 

10  5 

10  5 

69 

105 

106 

54 

106 

d 

105 

85 

105 

105 

6  9 

105 

106 

50 

106 

g 

105 

44 

105 

105 

21 

105 

106 

12 

106 

f 

105 

97 

105 

105 

83 

105 

106 

56 

106 

g 

105 

51 

105 

105 

15 

105 

106 

5 

106 

h 

105 

79 

10  5 

105 

69 

105 

106 

39 

106 

IVa 

105 

502 

650 

105 

410 

630 

106 

290 

636 

b 

105 

465 

840 

105 

561 

840 

106 

276 

848 

Va 

Sample 

— 

b 

105 

67 

105 

105 

53 

105 

106 

22 

106 

c 

105 

74 

10  5 

105 

54 

10  5 

106 

43 

106 

d 

105 

84 

105 

105 

51 

105 

106 

40 

106 

e 

105 

6  7 

105 

105 

47 

105 

106 

36 

106 

f 

105 

78 

105 

105 

64 

105 

106 

45 

106 

g 

10  5 

95 

105 

105 

78 

105 

106 

70 

106 

h 

105 

85 

105 

105 

89 

105 

106 

83 

106 

i 

105 

81 

105 

105 

89 

105 

106 

83 

106 

j 

105 

78 

105 

105 

92 

10  5 

106 

96 

106 

k 

105 

62 

105 

105 

35 

10  5 

106 

17 

106 

1 

105 

86 

105 

105 

65 

105 

106 

53 

106 

The 

reader  is 

r  em 

inded 

thlifc  this  Table  is 

included 

mer 

ely  to  show 

th 

e  source  of 

the  data  in 

Table  LA. 

It 

is  no 

t  essenti 

al  to 

an  understanding  of  the 

dati 

a  in 

Table 

1A, 

nor 

to  the 

conclusions 

drawn 

therefrom. 

2Uoll:  nolle etive  mark. 
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Table  1  (Con  ti nue d ) 


Best  Third  Middle  Third  Poorest  Third 


Item 

No . 

Ans¬ 

wered 

Coll 

Mark 

Poss- 
.  ible 
Marks 

No. 

Ans¬ 

wered 

Coll 

Mark 

Poss- 
.  ible 
Marks 

No. 

Ans¬ 

wered 

Coll 

Mark 

poss- 
.  ible 

Marks 

Vm 

105 

92 

105 

105 

85 

105 

106 

81 

106 

n 

105 

86 

105 

105 

92 

105 

106 

104 

106 

0 

105 

60 

105 

105 

48 

105 

106 

35 

106 

P 

105 

81 

105 

105 

60 

105 

106 

42 

106 

<1 

105 

78 

105 

105 

84 

105 

106 

83 

106 

r 

105 

49 

105 

105 

35 

105 

106 

32 

106 

s 

105 

68 

105 

105 

50 

105 

106 

58 

106 

Via 

70 

248 

550 

65 

176 

525 

65 

151 

525 

b 

70 

102 

210 

r  rr 

QO 

55 

195 

65 

57 

195 

c 

70 

217 

280 

65 

176 

260 

65 

125 

260 

VII 

57 

421 

684 

41 

260 

492 

58 

156 

456 

VIII 

81 

685 

972 

75 

458 

876 

82 

587 

984 

IX 

82 

658 

984 

85 

488 

1026 

80 

548 

960 

Xa 

28 

84 

112 

29 

67 

116 

39 

79 

156 

b 

28 

65 

112 

29 

55 

116 

39 

51 

156 

c 

28 

55 

112 

29 

42 

116 

59 

28 

156 

XIa 

70 

289 

420 

79 

264 

474 

6  6 

72 

596 

b 

70 

251 

420 

79 

206 

474 

66 

110 

596 

Xlla 

75 

322 

450 

67 

234 

402 

57 

172 

542 

b 

75 

535 

450 

67 

252 

402 

57 

167 

342 

XIII 

56 

472 

672 

60 

466 

720 

59 

365 

767 
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Table  1A 


IUDEX  OF 


DISCxtILlIlATIOiJ  OF  FACE  TE1T  ITEM. 


I  tern 

Pe rcentage 

Best  Middle 

Correct 

Poorest 

Index  of 
Discrimina 

la 

64  % 

53  % 

53% 

26 

b 

69% 

54 

45 

26 

c 

60 

45 

rzo 

28 

d 

52 

57 

42 

10 

Ila 

53 

37 

20 

53 

b 

68 

44 

35 

33 

G 

54 

41 

27 

27 

Ilia 

42 

24 

20 

22 

b 

85 

56 

43 

42 

c 

89 

6  o 

51 

38 

d 

81 

66 

47 

34 

ee 

42 

20 

11 

31 

f 

93 

79 

53 

40 

g 

30 

14 

5 

25 

h 

75 

66 

37 

58 

ITa 

80 

65 

45 

45 

b 

55 

43 

32 

23 

Va 

b 

64 

50 

-  Sample  - 

21 

43 

c 

70 

51 

40 

50 

d 

80 

49 

38 

42 

e 

64 

45 

54 

SO 

f 

74 

61 

42 

32 

g 

90 

74 

66 

24 

h 

81 

58 

43 

38 

i 

77 

85 

80 

-3 

74 

88 

91 

-17 

k 

60 

33 

16 

44 

1 

82 

62 

50 

50 

18 


Table  1A  f  G on t inue  d ) 


Percentage  Correct  Index  of 


Item 

Best 

Middle 

Poorest 

Discriminat 

Vm 

90% 

80% 

80% 

10 

n 

81  . 

90 

98 

-17 

0 

60 

46 

31 

29 

P 

77 

60 

40 

37 

74 

80 

80 

-6 

& 

47 

34 

30 

17 

s 

65 

50 

37 

28 

Yla 

71 

54 

40 

31 

b 

49 

30 

20 

29 

c 

74 

64 

48 

26 

VII 

62 

£ 

o  ^ 

30 

'aO 

VIII 

71 

50 

39 

32 

IX 

66 

44 

36 

30 

Xa 

75 

60 

50 

25 

b 

56 

47 

52 

24 

c 

50 

36 

18 

32 

XI  a 

71 

56 

19 

52 

b 

60 

43 

30 

50 

Xlla 

73 

58 

50 

25 

b 

74 

62 

49 

25 

XIII 

70 

65 

47 

23 

19 


20 

Discriminating  Powers  of  Each  Item 


Prom  my  study  of  the  data  contained  in  the  two 
tables  immediately  preceding, a  number  of  facts  emerge. 

These  facts  I  should  like  to  call  to  your  attention:  On 
item  1(c)  it  is  worthy  of  note  that  as  we  go  f  rom,T  Poo  rest M 
to  "Best"  fewer  candidates  attempt  this  option.  I  can  find 
no  part  of  the  course  where  the  material  that  item  1(c) 
tests  could  be  incorporated. 

Despite  the  preponderance  of  "An,s  in  my  sampling, 
no  "A"  has  attempted  this  option.  The  marks  made  by  those 
who  did  try  it  v/ere  very  low.  It  is  probable  that  the 
average  and  better  students  would  rule  out  item  1(c)  on 
account  of  the  fact  that  the  other  options  of  this  question 
were  taken  directly  from  the  course  and  so  could  be  trusted 
to  yield  higher  score  dividends.  All  in  all,  this  appears 
to  be  a  useless  item. 

Item  1(d)  gave  a  better  score  to  the  "Middle” 
group  than  it  did  to  the  "Best"  group,  and  in  addition  to 
this  it  has  a  very  low  index  of  discrimination.  This  item 
covers  one  complete  sub-topic  of  the  course.  In  all 
probability  it  was  presented  on  the  answer  paper  in 
somewhat  the  same  form  as  in  class.  For  this  reason  it 
is  suggested  that  the  higher  mark  of  the  "Middle"  group 
may  be  the  result  of  "cramming." 
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It  may  be  noted  from  tbs  table,  too,  that 
about  one-htlf  the  candid,  tes  of  the  srn  Her  schools 
prefer  this  option.  In  the  case  of  the  larger  schools 
it  shares  its  popul  rity  almost  equally  with  1(a). 

Question  So.  2  distinguished  between  the 
"Poorest"  and  ''Best"  better  than  any  of  the  options 
on  Question  I,  but  only  slightly  so.  It  represents 
a  testing  of  knowledge  that  is  picked  up  incidentally 
and  one  might  expect  it  to  be  picked  up  by  the  B’s 
and  C!s  to  as  great  an  extent  as  by  the  A’s,  but 
here,  as  in  most  other  aspects  of  the  test,  the 
ATs  are  superior. 

The  eight  iteas  of  uestion  III  varied  from 
22  to  40  (Index  of  Discrimination.)  The  best  known 
item  was  "Monroe  Doctrine,"  the  poorest  "Holy  See." 

In  this  question  the  word  "Comintern"  appears  at 
the  end  of  a  line,  end  the  next  line  begins  with 
"Mandates."  Despite  the  fact  that  the  relative 
position  of  these  words,  and  the  intervening  punctu¬ 
ation  should  serve  adequately  to  separate  them  in 
the  re  ader 1  s  mind,  about  22  .percent  of  the  candidc  oes 
evidently  read  "Comintern  mandates"  and  thus  lost 
the  marks  on  at  least  one  oi  tne  items .  ~J~ slip, 


i.  '  , 


* 


r 


22 


jus.de  by  almost  one -quarter  of  the  candidates, 
offers  some  slight  hint  of  the  emotional  states 
of  a  goodly  number  of  our  candidates  at  the  time 
of  wr  iting  f  i  nal  e  xarni  nat  i  ons . 

Question  III  poses  the  interesting  query-- 
"  Should  a  Grade  XII  student  be  expected  to  know 
the  " thing”  itself  or  all  the  various  synonyms 
corresponding  to  the  "  thin,  t  "  Ey  that  I  mean. 

Should  the  G-rade  XII  student  be  expected  to  under¬ 
stand  the  significance  of  an  institution,  a  policy, 
or  an  event,  or  should  he  be  expected  to  recognize  it 
under  any  of  the  great  v:rieties  of  names  that  in 
the  course  of  time  cluster  around  such  forms?  In 
this  question  "Holy  See",  "Most  favoured  n;  tion 
treaty,”  and  "Comintern"  represent  ideas  that  may 
be  expressed  in  a  variety  of  ways. 

On  the  other  hand,  "Monroe  Doctrine," 

"Open  Door  policy  in  China,”  and  "Mandates"  all 
signify  ideas,  the  expression  of  which,  by  and  large, 
is  confined  to  a  single  la  bid.  In  the  three  cases 
in  which  the  things  designated  are  each  universally 
known  by  a  single  name  the  score  is  75  percent  or 
higher.  In  the  three  cases  where  the  things  des¬ 
ignated  re  known  by  a  variety  of  names,  the  score 
ranges  from  50  per  cent  to  42  per  cent.  These 
results  seem  to  indicate  that  the  student  is  handi¬ 
capped  by  meeting  a  strange  name  for  a  familiar  idea. 
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Question  V  offers  some  eighteen  items 
dealing  with  persons  in  the  news.  This  was  the  only 
purely  current  event  question  on  the  paper  and,  as 
might  be  expected  was  answered  correctly  by  a  larger 
number  of  students  than  was  any  other  question.  It 
was,  on  the  whole,  the  poorest  of  all  the  questions 
in  the  matter  of  di  scr  iminating  the  best  third  from 
the  poorest  third.  lour  items  of  this  (question 
actually  show’  a  minus  index  of  discrimination;  i.e., 
on  these  four  items,  namely  (i),  (y),  (n)  ana  (q), 
the  poorest  third  did  better  than  the  best  third. 

It  may  be  pointed  out  here  that  the  two  items,  fb) 
snd  (k) ,  having  tie  highest  index  of  discrimination, 
are  items  that  could  only  be  let  med  from  Social 
Studies  texts  or  references.  Items  (j)  and  fn)  each 
had  an  index  of  discrimination  of  -17,  and  hence 
along  with  a  number  of  accompanying  items  of  a 
positive  but  very  low  index  would  appear  to  have 
no  value  whatever  as  test  items. 

yith  Question  VI  we  reach  the  first  of 
the  options.  The  three  items  here  used  seem  to  be 
of  almost  equal  value  as  a  means  of  sorting  cut 
the  best  from  the  worst.  This  option,  as  each  of 
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the  others,  other  things  being  equal,  we  would  expect 
to  be  attempted  by  approximately  197^  students. Quest  ion 
VI  drew  slightly  over  its  normal  quota. 

Question  VII  was  attempted  by  a  number  noticeably 
less  than  the  197  we  might  expect.  Especially  is  this 
less-than-normal  number  noticeable  in  the  middle  and 
poorest  groups.  I  am  unable  to  suggest  why  this  question 
was  attempted  by  only  two -thirds  the  number  one  might 
expect . 

The  question  which  deals  with  the  failure  of 
the  German  Republic? ,(No.8) ,  was  answered  by  236  students, 
or  approximately  one-third  more  than  chance  would  suggest. 
The  causes  for  the  popularity  of  this  question  and  the 
one  following,  No.  IX,  are  obvious  from  a  casual  obser¬ 
vation  of  texjs  and  manual.  This  question  deals,  too, 
with  a  matter  that  would  at  the  moment  (June,  1940)  be 
uppermost  in  the  popular  mind. 

No.  X  was  the  least  popular  of  the  options 
offered  in  Part  0.  It  was  so  for  the  same  reason, 

I  believe,  that  No.  1(c)  was  the  least  popular 
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Prom  Question  VI  to  the  end  of  the  paper 
there  are  8  questions,  5  of  which  must  be 
answered.  It  is  assumed  then  that  normally 
5/8  of  the  total  cases  would  attempt  each 
option. 
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question  of  Part  A.  Tiie  course  at  no  place 
seemed  to  demand  a  specific  consideration  of 
the  material  covered  by  this  question.  It  is  not 
surprising  to  find,  then,  that  the  three  items 
which  comprise  it  are  among  the  lowest  in  di  scr inl¬ 
ine  tor  y  pow  er  s . 

question  XI (a)  has  an  I.D.  of  52.  The 
knowledge  necess  ry  to  answer  it  is  not,  as  far  as 
I  can  find,  avail,  ble  in  t he  text,  nor  in  the  manual . 
At  least,  such  knowledge  cannot  be  found  at  either 
source  in  its  required  form.  Its  index  of  discrim¬ 
ination  is  higher  by  some  twelve  r  fifteen  points 
than  that  of  tny  of  the  other  options.  This  seems 
to  indicate  a  tendency  for  the  more  obscure  items 
to  serve  as  a  better  medium  of  d  1  sc r|Mi nation  than 
the  more  obvious  items.  Yor  examiple:  to  return 
$ o  question  Y,  the  most  obvious  bit  of  current 
information  asked  for  in  this  question  was  a  know¬ 
ledge  of  Chiang  Kai-Shek.  Its  index  of  discrimination 
was  -17.  The  Item  least  mentioned  in  the  course,  and 
no  longer  of  current  interest.,  viz.  ,  a'  knowledge  ox 
Sir  Xric  Drummond,  has  an  index  of  discrimination  of 
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Tiie  two  items  that  comprise  Question  XII 
prov e  quite  normal  in  the  number  of  students  who 
answer,  but  the  index  number  of  each  is  among  the 
lowe  st. 

Question  XII  represents  the  only  attempt  that 
the  test  paper  makes  to  test  any  of  the  results  of 
the  revised  techniques  and  objectives.  Its  index, 
number,  too,  is  one  of  the  lowest.  That  is  to  say, 
as  a  question  it  ms  not  highly  useful  in  marking  off 
the  bad  from  the  guoa.  It  was  answered  by  a  normal 
number  of  candidates.  The  poorest  group  did  better 
here  than  it  did  on  any  other  of  the  options,  with 
about  three  exceptions.  The  best  group  achieved 
approximately  the  same  average  mark  that  it  made 
on  each  of  the  other  optional  items. 

The  response  to  ho.  XIII  suggests  that,  by 
and  large,  the  new  techniques  have  not  found  wide¬ 
spread.  apq  lie  tion  in  our  schools.  The  relatively 
goon  response  of  the  poorer  section  may  be  due  to 
the  fact  that  the  poorer  group  is  made  up  of  older 
students,  fven  a  ye  rTs  age- difference  at  this 
level  may  represent  a  great  difference  in  maturity. 
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There  is  no  doubt  that  ability  to  read  and  inter¬ 
pret  ma terial  of  this  nature  does  improve  with 
maturation,  even  when  there  has  been  no  advance 
in  formal  educational  achievement,  nd  we  would, 
to  repeat,  exqect  to  find  more  adults  in  the  poorest 
gro  up . 

As  has  been  mentioned  above.  Question  XIII 
represents  the  only  attempt  made  on  this  paper  to 
test  for  any  of  the  new  objectives  laid  down  by 
the  revised  course.  It  seems  inadequate  insofar 
as  only  one  objective  was  tested  by  this  nnew" 
question,  viz.,  ability  to  interpret  historical 
material.  There  are  eight  objectives  for  the  Social 
Studies  stated  by  the  Programme  of  Studies  for  the 
Intermediate  School,  and  some  fourteen  objectives 
implied. 

I  shall  refer  to  the  above  aspect  of  the 
paper  more  fully  in  the  Chapter  that  follows. 
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CHAPTER  IV 

DISTRIBUTION  OF  MARKS. 


It  is  the  purpose  of  this  chapter  to  £ive  the 
reader  an  adequate  idea  of  how  the  marks  for  each 
question  were  distributed  among  the  315  cases  studied. 

This  aspect  of  our  investigation  should  serve  to  indi¬ 
cate  in  some  measure  the  "usefulness”  of  each  item  on 
the  test.  If,  for  example,  we  find,  as  we  actually  do 
find  in  Question  I,  that  the  distribution  of  marks  for 
any  given  question  approximates  the  normal  distribution, 
then  it  is  indicated  that  this  question  is  functioning 
to  some  exent  in  measuring  what  it  purports  to  measure, 
and  hence  has  some  degree  of  validity. 

The  reader  is  reminded  here  that  the  statis¬ 
tical  data  presented  in  this  chapter  serve  but  to  indicate 
certain  possibilities  and  tendencies.  In  a  subject  such 
as  Social  Studies,  where  so  much  is  dependent  on  personal 
feelings  and  attitudes,  very  little  indeed  is  susceptible 
of  absolute  proof.  Such  data  as  is  presented  here,  how¬ 
ever,  do  serve  some  useful  prupose  in  our  search  for 
improvement . 
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By  way  of  helping  the  reader  who  may  be  inex¬ 
perienced  in  such  procedures  to  understand  the  material 
of  this  chapter,  I  shall  set  down  the  frequency  table 
for  Question  I  as  follows: 

TABLE  II 


FREQUENCY  TABLE  FOR  QUESTION  I 


Scores^ 

p 

Frequency 

1 

10 

3 

3 

5 

16 

7 

17 

9 

24 

11 

36 

13 

40 

15 

51 

17 

46 

19 

27 

21 

25 

23 

18 

25 

2 

No.  of  Studehts  315 

From  the  data  of 

such  frequency  tables  a  column 

diagram  was  drawn  to  illustrate  the  distribution  of  the 

scores  for  each  question. 

I  may  point  out  here  that  in 

1 

These  scores  are  in  steps  of  2.  ,fl"  in¬ 
cludes  "0"  and  "1".  n3"  includes  l,2n 

and  ”3”,  etc. 


^Number  of  students  who  made  the  corres 
ponding  score. 
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Figure  1,  illustrating  the  distribution  of  scores 
for  Question  I,  the  base  line  is  numbered  in  steps 
of  2.  This  was  made  necessary  by  the  fact  that 
Question  I  is  valued  at  25  marks,  and  space  does  not 
allow  the  abscissa  of  the  diagram  to  be  numbered  in 
steps  of  1.  All  the  other  column  diagrams  of  this 
chapter  are  numbered  in  intervals  of  1, 

The  column  diagram  (using  Figure  1  as  an 
illustration)  enables  us  to  answer  such  questions 
as  the  following: 

1.  How  many  people  made  a  score  of  8-9?  (24) 

2.  How  many  people  made  a  score  of  20—22? ( 25 ) 

3.  Is  a  score  of  12-16  high,  low,  or  average? 

(Average ) . 

4.  What  is  the  mode?  (14,5) 

and  many  other  questions  of  a  similar  nature. 

The  series  of  column  diagrams  will,  in  short, 
answer  a  number  of  questions  designed  to  throw  some 
light  on  the  relative  efficiency  of  each  of  the  13 
questions  as  a  testing  device,  and  insofar  as  they  do 
that  they  will  serve,  along  with  the  index  of  discrim¬ 
ination,  as  a  measure  of  the  validity  of  the  paper. 

The  reader  will  find  a  number  of  observations 
concerning  each  question  on  the  page  following  the 
corresponding-  illustration. 
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Figure  1 

Distribution  of  Scores  for  Question  I.- 
S15  Oases 
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‘Figure  No.  1  shows  the  distribution  of 
marks  for  Question  I.  This  question  was  answered 
by  each  of  the  315  cases.  Its  index  of  discrimin- 
ati  on  is  low  ;  that  is  to  say,  it  proved  but  a  poor 
instrument  in  discriminating  between  the  best  and 
poorest  groups.  About  77  per  cent  of  the  candi¬ 
dates  me.de  50  per  cent  of  the  raw  score,  or  over. 

It  must  be  pointed  out  here,  of  course,  that  this 
question  represents  four  possible  options  and  we 
would  consequently  expect  to  find  a  higher  general 
score  here  than  proves  to  be  the  case. 
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Scopes 

Figure  2 


Distribution  of  Scores  for  Question  II.- 
315  cases. 
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Figure  No.  2,  which  illustrates  the  distri¬ 
bution  of  marks  for  Question  II,  shows  that  only 
37  per  cent  of  the  candidates  have  made  50  per  cent 
or  over  of  the  marks. 

Its  difficulty  as  compared  with  Question  No.  1 
may  be  accounted  for  partly  by  the  fact  that  Question 
No.  1  contained  four  options  and  would  be  more  likely 
to  fall  within  the  candidates’  field  of  knowledge, 
and  partly  by  the  fact  that  this  Question  II  had  to 
do  with  geography.  Though  the  possibility  of  a 
question  in  geography  might  be  inferred  from  the 
outline  of  the  course  of  studies  it  is  not  brought 
clearly  to  the  teacher’s  attention. 
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Figure  5. 

Distribution  of  Harks  for  Question  III.- 
53- o  ca-  e s. 


Tiie  distribution  of  narks  on  Question  III 
snows  that  188  cases,  or  approximately  60  percent 
of  those  who  answered  it,  made  50  per  cent  or  more. 
Question  III  consists  of  eight  distinct  and 
mutually  unrelated  items.  Practically  eveiy  one 
of  these  items  showed  a  higher  discriminatory  power 
than  any  of  the  items  in  the  questions  preceding. 
Though,  relatively  speaking,  but  a  small  number 
of  items  was  offered,  this  question  made  in  itself 
a  mi  ni  c.t  ure  ob  je  c  ti  ve  e  x.  mi  nat  ion,  and  the  i  t  ems , 
though  few  in  number,  covered  a  comparatively  wide 
section  of  the  c curse.  In  any  ease  it  was  known 
noticeably  better  by  the  best  third  than  by  the 
poorest. 
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f  cores 

Figure  4. 


Distribution  of  Marks  for  Question  IV.- 
315  cases* 
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Figure  4,  illustr  ting  tlie  distribution  of 
marks  for  Question  IV,  shows,  at  first  glance,  an 
unusual  distribution,  A  frequency  polygon  constructed 
on  top  of  this  column  diagram  would  show  a  constant 
drop  in  the  curve  from  the  21st  percent  to  the  57th 
percent  interval;  that  is  to  say,  from  a  score  of 
5  to  a  score  of  8.  It  also  is  bi-modal,  with  same 
one  mode  located  at  score  5  and  the  other  at  score  9. 

It  has  a  much  higher  index  of  discrimination  for  the 
(gjfc  part  of  the  question  than  it  has  for  the  (b)  part. 

These  variations  from  the  normal  may  be 
accounted  for  by  the  fact  that  the  two  parts  measure 
different  values.  Part  (a)  asks  for  very  slight 
knowledge  of  six  treaties  chosen  irom  el  even  options. 
This  part  seems  in  the  main  to  be  measuring  recognition. 
The  (b)  part  sets  down  a  few  of  the  terms  of  each 
treaty  listed  in  (a)  and  the  candidate  is  requested 
to  associate  the  terms  of  (b)  with  the  proper  treaty 
of  (a).  This  (b)  part,  then,  appears  to  measure 
recall  and  hence  for  most  students  would  be  more 
dif fi  cult. 

It  has  a  noticeably  higher  score-result  on 
the  (a)  part  than  on  the  (b).  Thi  s  may  be  explained 
by  the  fact  that  more  students  would  know  one_  fact 
about  any  given  treaty  than  would  know  two  facts 
about  the  same  treaty. 
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Score  5 

Figure  5. 

Di  s  tri  bu  ti  on  of  Marks 
T 15  cases. 


for  Question  5.- 
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Figure  5  illu  stratfesn  the  distribution  of 
marks  on  Question  V.  This  is  the  last  of  the 
compulsory  questions  and  thus  the  last  of  the  questions 
to  be  answered  by  the  whole  315  cases..  In  this 
question  about  74  per  cent  of  the  total  number  of 
cases  made  50  per  cent  of  the  marks,  or  over. 

Of  the  eighteen  items  asked  in  this  question 
i  t  is  interesting  to  note  that  the  most  difficult  and 
most  obscure  of  the  iteius,  viz.,  item  (b^has  the 
greatest  power  of  discrimination,  43.  Two  of  the 
more  obvious  items,  (i)  and  (n),  actually  have  a 
minu  s  di  s  cr  imiha t i  on . 

As  might  be  expected  on  a  question  of  this 
nature,  a  larger  percentage  made  a  perfect  mark 
than  did  so  on  any  other  question  in  this  section. 
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Figure  6. 


Distribution  of  Marks  for  Question  VI,- 

207  cases. 
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The  accompanying  illustration  for  Question 
VI  shows  the  distribution  of  marks  on  207  cases. 
Sixty-one  per  cent  of  these  207  candidates  made 
50  per  cent  of  the  marks,  or  over. 

Its  index  of  discrimination,  32,  is  about 
average  for  questions  of  this  general  type.  The 
raw  score  for  the  (b)  section  was  low,  ranging  from 
£0  per  cent  correct  in  the  poorest  group  to  49  per 
cent  correct  in  the  best  group.  It  is  not  at  all 
clear  why  much  higher  marks  should  be  made  on  the  (a) 
and  (c)  items  of  Hi  is  question  than  on  item  (b). 

The  same  books  and  manuals,  I  believe,  that  might  be 
utilized  as  sources  for  the  answer  material  required 
in  tiie  fa)  and  (c)  parts  would  prove  useful  in 
answering  this  item  also. 
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Fig  ure  7 

Distribution  of  Marks  for  Question  VII- 
141  cases. 
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Figure  7,  illustrates  the  distribution 
of  m  rk s  on  Question  VII.  One  hundred  and 
forty-one  candidates  answered  this  question. 
Approximately  61  per  cent  of  the  141  cases  made 
50  per  cent  or  over.  This  question,  you  will 
note,  falls  in  Part  G  and  is,  as  a  consequence, 
an  option.  Its  difficulty  is  to  some  extent 
indicated  by  the  fact  that  only  141  candidates 
out  of  a  possible  515  tried  it.  Though  a  normal 
fraction,  61  per  cent,  made  50  per  cent  of  the 
marks  or  over  on  this  question,  only  SO  per  cent 
made  75  per  cent  or  over. 
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Figure  8 


Distribution  of  Marks  for  Question  8 
236  cases. 
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Cn  ^ue sti on  VIII  approximately  65  per  cent 
made  50  per  cent  of  the  marks  or  over.  The  per¬ 
centage  of  marks  unde  on  this  question  is  higher 
than  any  of  the  three  preceding  questions  of 
this  section.  With  the  exception  of  Question  IX, 
(a  similar  question  on  Italy,)  Question  .VIII  was 
the  most  popular  of  the  optional  section  of  the 
entire  paper. 


: 


* 

1  -  !  ■  '  ..  J  ,:."r 


...  ,  i  L  ■; 


f  ~  .  Oj  *  :  .[J* 


I 


46 


Figure  0. 

Distribution  of  Marks  for  Question  IX.- 
156  eases. 
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Question  IX,  illustrated  by  the  accompany¬ 
ing  diagram.,  shows  a  distribution  somewhat  at 
variance  from  the  usual  pattern  found  in  an 
analysis  of  the  test  results  of  this  paper. 

Sixty  per  cent  of  the  156  cases  have  rua.de  50 
per  cent  or  over  on  this  question,  but  of  this 
60  per  cent  almost  25  per  cent  of  the  candidates 
have  made  between  50  per  cent  and  60  per  cent. 
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SCoR.ES’ 

Figure  10. 

D is  t ri  bu  ti  o  n  of  Marks  f or  ^,ue  s ti  on  10 .  - 
97  cases. 
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Question  X  was  answered  by  only  97  candidates 
out  of  a  possible  315,  Normally  we  would  expect 
197  students  to  choose  this  question.  Only  56  per 
cent  of  the  cases  made  50  per  cent  of  the  marks,  or 
over. 

The  relatively  small  number  of  students  who 
answered  this  option,  and-  tie  very  low  score  resulting, 
i  s  no  doubt  due  to  the  fact  that  this  question  does 
not  appear  to  be  a  part  of  the  course.  It  may  be 
argued  that  the  material  required  to  answer  this 
question  adequately  is  implied  in  the  course  of 
studies.  The  fact  that  no  single  student  out  of 
the  515  cases  dealt  with  was  able  to  answer  the 
question  so  as  to  obtain  full  marks  would  seem  to 
indicate  the  fact  that  the  course  of  studies  does 
not  imply  the  need  for  this  knowledge.  Besides 
this,  it  is  pointed  out  that  this  question  called 
for  specific  and  very  definite  facts.  It  vjas  in 
no  way  an  effort  to  measure  any  oi  the  new  oojec  lives 
of  the  revised  course.  Its  index  oi  discrimination, 
its  distribution  of  marks,  the  fact  that  well  ovei 
two  -thirds  of  the  candidates  avoided  ensweiing  j-  t, 
all  these  factors  indicate  that  this  particular 
question  has  no  pi  ce  on  a  test  for  Social  ttuai  es  . 
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Figure  11. 

Distribution  of  Harks  for  Question  XI.- 
235  oases. 


Tile  distribution  of  marks  on  Question  XI 
shows  tii.  t  58  per  cent  have  made  the  conventional 
"pass",  or  over.  On  the  two  items  of  this 
question,  it  is  worth  noting  that  in  the  two 
items  (a)  and  (b)  the  best  third  of  the  cases 
do  much  better  on  the  (a)  part  than  on  the  (b). 
The  poorest  third  of  the  cases  do  noticeably 
better  on  the  (b)  part.  The  explanation  for 
this  may  be  in  the  fact  that  the  (b)  part  of 
this  question  may  be  interpreted  as  current 
events. 

It  has  come  to  my  attention  a  number 
of  times  in  my  efforts  to  analyze  this  test 
p  ap  e  r  tha  t  t  he  p  o  or  e  st  s  tud  e nt  s  in  So  ci  a  1  S tud  i  e  s 
are  at  their  best  in  current  events,  and  as  has 
been  shown,  in  a  number  of  items  of  Question  V, 
sometimes  surpass  the  best  group. 
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Figure  12. 

Distribution  of  Marks  for  Question  XII.- 
200  cases. 


In  question  XI i,  the  distribution  of  marks 
snows  that  7o  per  cent  of  the  students  who  answered 
this  question  mide  30  per  cent  of  the  marks,  or  over 
This  is  higher  than  the  average  by  some  13  per  cent. 
There  is  a  m:  rked  similarity  between  the  scores  ob¬ 
tained  on  the  (a)  and  (b)  parts  of  this  question, 
question  XII  was  .answered  by  200  candidates,  which 
is  about  the  number  which  chance  would  dictate. 

Its  index  of  discrimination  is  low- -equally 
so  on  'both  items.  It  is  low  because  the  poorest 
group  made  exceptionally  high  marks  on  this  question 
To  refer  back  to  the  similarity  of  scores 
made  on  the  two  parts  of  this  question,  it  may  be 
well  to  mention  here  that  on  the  greater  number  of 
these  sub -que  stions.  such  a  similarity  i  s  not  always 
ap  pa  re  nt .  Wher  e  th  i  s'  s  i  mi  la  r  i  ty  is  co  n  s  i  ste  nt  1  y 

lacking  it  would  seem  that  the  same  section  of  the 
course  is  not  being  tested.  Particularly  in  that 
section  of  the  course  where  there  are  a  great  number 
of  options  allowed  there  would  appear  to  be  an  in¬ 
justice  suffered  by  the  candid-  te  ix  two  or  more 
sections  of  tia  course  are  tested  by  a  single 
que  stion.  ue  stions  X  and  ml,  p  ex' haps,  sj. 
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Figure  13 . 

Distribution  of  Marks  for  Question  XIII, 
184  cases. 
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Seventy  seven  per  cent  of  the  cases  made 
50  per  cent  or  over  of  the  marks  on  Question  XIII* 

This  is  the  highest  number  to  make  the  conventional 
"pass  mark"  on  any  question  in  Part  0.  It  is  equalled 
only  in  question  I,  where  there  are  four  options 
offered.  This  question  may  be  said  to  be  the  only 
effort  made  by  our  examiners  to  test  any  objective 
other  than  the  retention  of  factual  material.  Other 
questions  may  purport  to  measure  other  objectives, 
but  as  long  as  the  answer  to  each  of  them  may  be 
lifted  whole  from  any  number  of  books,  then  the 
objective  actually  being  measured  is  the  retention 
of  factual  material .  Of  the  total  sixty-odd  items 
on  this  test  paper,  only  the  items  of  Question  XIII 
may  be  said  to  measure  something  other  than  factual 
knowl  edge. 

The  question  was  attempted  by  184  cases.  The 
poorest  group  did  comparatively  well,  and  consequently 
its  index  of  discrimination  is  relatively  low. 

Coming  at  the  end  of  a  long  pa  sr ,  it  is  possible 
full  justice  was  not  done  to  it.  It  is  thebest 
group  of  students  who  would  suffer  here,  for  it  is 
they  who  write  most  and  as  a  rule  are  most  often 
pres  ed  for  time  at  the  end. 
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I  suspect,  too,  than  an  effort  to  measure  a 
skill  of  the  sort  that  Question  XIII  attempts  to 
measure  had  best  be  done  objectively  or  not  at  all. 
Especially  is  this  true  in  a  question  of  this  type, 
where  there  are  four  distinct  items.  Some  markers 
have  a  tendency  to  give  the  student  the  benefit  of 
the  doubt  where  a  single  mark  is  concerned — others 
allow  the  student  no  such  advantage.  The  same  answer 
to  question  XIII,  if  it  were  marked  by  markers  of 
the  types  mentioned  could  thus  vary  by  one-third 
its  total  value,  or  33  per  cent. 
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1MT  DOES  THE  Eft.  PER  TEST? 
A.  The  Objectives  Tested. 


J’There  can  be  no  doubt  that  faulty  tech¬ 
niques  of  testing  and  examining  are  in  a  large  measure 
responsible  for  the  aridity  of  school  courses  and  the 
barrenness  of  their  results.  Naturally  the  type  of 
examination  determines  the  type  of  tending  procedure. 

Tiie  prevailing  type  of  examination  puts  a  premium  on 
the  reproduction  of  memorized  subject-matter.  It  does 
not  test  lor  tiie  realization  of  professed  objectives. 

As  stated  in  the  Programme  of  .Studies  for  the  Elementary 
School,  the  pupils’  learning  should  eventuate  in  tne 
following  desirable  outcomes;  knowledge,  wi  th  in  si  ...  t 
and  understanding;  habits;  skills;  interests  and 
appreciations;  attitudes  and  ideals.  it  is  the  busi¬ 
ness  of  examiners  to  test  for  these  outcomes."1 

The  excerpt  from  the  departmental  regulations 
lUotea  above  nakes  clear  txe  general  objectives  of  the 
revised  course.  It  makes  clear,  too,  the  part  that 
the  official  testing  program  might  be  expected  to  play 
in  the  achievement  of  those  objectives.  It  shall  now 
be  my  purpose  to  examine  the  §oc  ial  Studies  5  paper 
of  1940  in  tne  light  of; 

(a)  The  general  objectives  of  tests  and  exam¬ 
inations  as  set  forth  in  tne  Programme  of  Studies  for 
Intermediate  Schools,  page  13,  and, 

(b)  The  fundamental  objectives  of  the  Social 
Studies  programme  from  page  29  of  the  same  publication. 


^Prug ramie  of  Studies  for  the  Interne diate 
Sch  oo  1 ,  p .  12 
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To  do  this  it  is  necessary  to  scrutinize  each 
item  on  the  test  and  indicate  insofar  as  it  is  possible 
the  type  of  answer-mo terial  required,  and  the  sources 
from  vfoieh  it  might  be  obtained,  as  a  further  guide  to 
an  understanding  of  the  professed  aims  of  the  revised 
course  .  I  shall  set  down  here  the  gene  ral  ob je c tive 
that  would  apply  in  t  he  case  of  Eigh  School  tests,  via: 

"2.  It  will  be  the  endeavour  of  the  Board  to 
mane  the  examination  of  such  a  character  that 
it  will  defeat  "cramming",  and  offer  no  encour¬ 
agement  to  teaching  that  is  aimed  directly  at 
examination  results.  In  o t he r  wo  rd s ,  t he  exam¬ 
ination  will  require  the  adjustment  of  teaching 
procedures  to  the  objectives  of  the  pregramme." 1 

Question  I  offers  four  options,  two  of  which 
are  indicated  as  complete  units  in  the  c curse  of 
study.  I  have  pointed  out  above  that  only  those  two 
options,  (a)  md  (d),  were  answered  to  any  extent  on 
the  answer  papers. 

Facility  in  answering  Question  II  could  easily 

be  acquired  by  map  drill. 

Question  III  for  the  most  part  presents  mat¬ 
erial  that  in  all  likelihood  would  not  be  "crammed" 
for  examination  purposes,  at  least  not  in  that  form, 
and  yet  even  here  six  out  of  eight  possible  marks  may 
be  procured  from  the  little  reference  (I  cAuli^-ie) ,  tuo  t 
wa  used  as  the  basic  text  oi  the  coin  se. 

Programme  of  Studies  ior  the  Intermediate 
Soiiool,  p.29. 
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J?ii0  two  i tem,s  of  question  IV  may  be  answered 
from  McAuliffe. 

Question  \f  nay  be  classified  as  a ''current- 
events  que sti on,  bub  even  here  six  of  its  eighteen 
items  may  be  answered  from  the  min  text. 

In  Part  C  of  the  paper  there  are  five 
quest  ions  to  be  answered,  out  of  eight.  Of  these 
tue  s t ion  VI ( b )  and  ( c )  i terns  only ,  Que  sti on  VII , 
Question  VII I, and  Question  IX  to  the  value  of  one- 
half  its  total  mark. may  all  be  answered  from  McAuliffe. 

By  actual  count  I  icma  tint  of  the  135  marks 
possible  to  obtain  on  the  raw  score1  of  this  paper, 

67  marks  may  be  obtained  by  an  intimate  acquaintance 
with  "Modern  Europe  Explained. "  This  gives  a  trans- 

i 

muted  score  of  45,  to  write h  there  might  be  a  maximum 
audition  of  15  for  English.  The  transmuted  score  is 
derived  from  the  raw  score  by  a  statistical  formula 
expl.  ined  in  Appendix  £. 

I  should  like  to  point  out  the  large  per¬ 
centage  of  the  paper  that  may  possibly  be  answered 
by  material  contained  in  the  Social  Studies  5  manual 
published  by  the  We  st  ern  Gan,  da  Institute.  Answer 

1  The  raw  score  is  the  value  on  the 
examination  paper.  It  is  the  actual 
score  given  each  question  by  the 
"  marker  . "  It  is  fu  r the  r  exp  la  i  ne  d 
in  Appendix  S. 
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material  for  either  £  two  options  of  Question  I,  viz., 
(a)  end  (b),  nay  be  found  in  the  above-mentioned  manual. 
In  Part  B  five  out  of  the  eight  items  of  Question  III 
may  be  found  here.  Questions  IV  fa)  and  (b)  may  also 
be  answered  from  this  source. 

In  Part  G  where  five  questions  are  required 
out  of  eight,  I  find  that  Questions  6,  7,  6,  9  and  12 
can  all  be  answered  from  material  contained  in  this 
manual.  Of  course  it  is  possible  that  other  factors 
th aii  the  points  mentioned  in  the  official  markers'  key 
h  ve  played  some  part  in  the  actual  scores,  but  a 
careful  check  would  seam  to  show  that  the  above- 
mentioned  questions  ecu. Id  all  be  answered  in  full 
from  an  intimate  knowledge  of  the  irate  rial  contained 
in  t  la  manual . 

It  would  appear  that  as  long  as  Departmental 
Social  Studies  examinations  my  be  passed  by  intensive 
study  of  any  of  tie  various  manuals  published  for 
commercial  purposes,  then  we  cannot  hope  to  achieve 
either  the  general  or  specific  objectives  of  the  new 
course . 

The  following  table  has  been  designed  to  give 
at  a  glimpse  the  aurce  whence  the  required  answer 
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TABLE  III. 

SOURCES  OF  A  NS  WE  R-I .  AT  E  RE  A  L 


Current  0 tte r  No  Sp ecific  Pre- 


62 . 

Ox*  tiie  thir  ty- two  items  di  s  tingiished  in 
Table  Ho.  Ill,  nineteen,  or  almost  60  percent,  of  the 
items  could  be  answered  by  a  student  whose  only  Social 
Studies  3  preparation  was  an  intensive  study  of  the 
Social  Studies  3  manual.  This  60  per  cent  of  the 
items  represents  a  possible  raw  score  of  105,  or  79 
per  cent  of  the  total  raw  score.  Add  th  this  -possible 
79  per  cent  another  15  percent  for  English  score,  and 
we  must  conclude  that  a  candidate  whose  sole  preparation 
for  the  examination  was  an  intensive  study  of  the 
manual  could  make  a  possible  net  score  of  94  per  cent. 

"Modern  Europe  Explained,”  by  W.  R,  McAuliffe, 
is  a  little  book  of  some  150  effective  pages.  It  is 
the  one  book  that  every  Social.  Studies  3  student  must 
own.  Inspection  of  Table  Mo.  Ill  shows  that  a  student 
whose  reading  consisted  only  of  this  text  could  make  a 
possible  raw  score  of  52.  If  his  English  mark  was  at 
the  higher  level  this  raw  score,  plus  very  little  more 
from  the  nap  question  alone  would  place  him  among  those 
safely” pas.,  ed,” 

It  has  not  been  argued  here,  of  course,  that 
the  teaching  procedures  suggested  as  possible  have 
been  widely  practiced  throughout  the  Province,  or  for 
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that  in  tter  have  been  practiced  at  all.  If, however, 

’’the  type  of  examination  naturally  determines  the  type 
of  teaching  procedure,” then  the  paper*  being  analyzed 
lie  re  can  have  nothing  but  a  detrimental  effect  upon 
the  teaching  procedures  throughout  our  province. 

To  clarify  the  table  that  follows,  I  shall 
set  down  here  from  the  Programme  of  Studies  the  funda- 
men  tal  ob  je  c  t  ives  of  the  Soc  ia  1  Stud  ie  s  Programme : 

”1.  To  facilitate  an  understanding  of  our 
social  and  economic  realities. 

”2.  To  develop  ability  to  see  both  sides 
of  a  question. 

”3.  To  induce  an  attitude  of  fairmindedness 
and  a  desire  to  co-operate  with  others  for 
t  be  welfare  of  t  he  community. 

”4.  To  train  students  in  tin  use  of  efficient 
methods  for  securing  and  organizing  information 
that  is  available  in  reference  books,  atlases, 
charts,  and  to  extend  their  use  of  such  tools 
ana  pictures,  diagrams,  maps,  graphs  ana 
statistical  data, 

”5.  To  make  clear  to  students  the  effect  of 
mechanization  on  the  production  of  goods  and 
services,  and  on  developments  in  transportation 
and  co  mmun ic  at i  on . 

"6.  To  develop  an  appreciation  of  Canadian 
c  uit  ur  e  . 

”7.  To  help  students  understand  the  contri¬ 
butions  of  explorers,  frontiersmen  and  states¬ 
men  to  the  grown  and  development  of  Canada, 
anu  the  British.  Commonwealth;  and  to  under¬ 
stand  the  contribution  made  by  Canada  to  the 
trade  of  the  Commonwealth  and  the  world. 
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,r6.  To  f  os  ter  an  attitude  of  tolerance 
and  respect  for  world  peoples,  and  a 
sympa the  ti c  under  st  ana  ing  of  the  ir 
social  and  economic  pr oblems  . 

The  following  table  is  presented  in  an 
attempt  to  show  at  a  glance  what  effort  has  been 
made  to  measure  each  of  the  official  objectives. 
The  horizontal  numbers  at  the  top  of  tie  table 
represent  the  fundamental  objectives  mentioned 
above.  The  vertical  numbers  represent  the 
questions  and  sub -quest  ions  where  it  was  thought 
advisable  to  set  them  down  separately.  Where 
an  item  is  marked  Mth  an.  ?lx"  ,  it  means  that  in 
that  par  t i  eu  lar-  qu  e  st  i  on  so  me  e  f  f o  r t  ha  s  been 
made  to  measure  the  indicated  objective.  In  the 
column  neaded  !fC"  I  have  checked  with  an  "x" 
every  item  that  coulo.  be  answered  by  previously 
prepared  material. 


1  Programme  of  Studies  for  the  Inter¬ 
mediate  School. 
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TABLE  IY 

HOW  TEST  ITEMS  MEASURE  OBJECTIVES. 


Objective s 

1 

2 

5 

4 

5 

6 

7 

8 

C 

la 

X 

X 

b 

X 

c 

X 

2 

X 

X 

r~z 

o 

X 

X 

4 

X 

X 

5 

X 

6 

X 

X 

7 

X 

X 

8 

X 

X 

9 

X 

X 

10 

X 

X 

11 

X 

12 

X 

X 

15 

X 
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The  value  of  the  above  table  as  a  scientific 
instrument  is  not  great.  It  has,  however,  some  slight 
value  as  a  check  on  the  amount  of  effort  the  examiners 
have  made  to  test  for  the  various  objectives.  It  will 
be  seen  at  a  glance  that  the  importance  of  objective 
No.  1  has  been  unduly  stressed.  Further  it  may  be 
noted  that  this  No.  1  objective  simply  means  the 
accumulation  of  factual  material. 

The  two  items  I  have  checked  in  Column  2 
may  or  may  not  represent  an  attempt  to  measure  the 
objective  of  that  column.  The  material  required 
to  answer  each  item  checked  in  column  "C"  may  be  found 
in  various  books  available  to  the  student,  and  further¬ 
more  it  may  be  found  in  a  form  that  satisfies  completely 
the  demands  of  the  test  paper.  This  being  so,  then, 
we  may  claim  in  connection  with  this  table: 

1.  That  only  one  objective,  viz..  No.  1,  is 
measured. 

2.  That  the  paper  does  nothing  to  defeat  the 
"crammer,"  but  that  rather  his  activity  is  encouraged. 

In  other  words,  it  would  appear  that  the  exam¬ 
iners’  attitude  towards  the  "crammer"  is  like  the 
attitude  of  Robespierre  towards  God — "If  He  does  not 
exist  we  must  create  Him." 
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One  might  say  here  that  the  term  "crammer" 
may  with  justice  be  applied  to  any  number  of  teachers 
as  well  as  students.  In  any  case,  as  long  as  the 
student "crammer"  remains  the  annual  recipient  of  a 
special  bonus  in  the  form  of  marks,  the  practice  of 
cramming  will  continue. 

B.  The  Adequacy  of  the  Sampling. 

The  Social  Studies  3  is  composed  of  the 
four  topics  listed  below. ^  To  determine  the  effic¬ 

iency  of  the  sampling  I  have  gone  over  the  examination 
paper,  examined  each  individual  item,  referred  to  the 
official  markers1  key  to  find  out  the  specific  answer 
material  required,  and  thus  determined  the  topic  of  the 
course  that  was  being  tested  by  each  item. 

Certain  difficulties  were  encountered,  but  on 
the  whole  the  items  corresponded  closely  to  the  topics 
of  the  course. 

In  Part  A  items  (a),  (b)  and  (d)  were  easily 
traced  to  their  sources  in  the  outline  of  the  course. 

9 

As  suggested  above  item  "cn  could  not  be  located  in 
the  outline. 
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In  Part  B  the  source  of  all  four  questions  could 
readily  be  determined.  All  of  the  questions  in  Part  C, 
with  the  exception  of  Question  XIII  were  easily  placed. 

In  my  tabulation  which  follows,  a  special  heading1  is 
improvised  for  Question  XIII,  viz.,  "Ability  to  Interpret 
Historical  Material." 

On  the  left  margin  of  the  examination  paper  and 
under  the  heading  "values",  there  is  a  total  of  169  marks. 

This  is  the  total  number  of  marks  on  the  paper  for  the 
total  thirteen  questions.  The  student,  however,  was 
supposed  to  answer  only  ten  of  the  questions.  The  perfect 
answer  paper,  therefore,  would  yield  10/13  of  169,  or  a 
maximum  raw  score  of  130.  I  have  set  down  in  column  1  of 
the  tabulation  which  follows,  /the  marks  that  could  be 
obtained  from  a  complete  knowledge  of  each  of  the  topics. 

In  Column  2  will  be  found  the  percentage  of  the  school 
year  to  be  devoted  to  the  preparation  of  this  topic.  In 
Column  3  will  be  found  the  percentage  of  marks  each  topic  offers, 
and  in  Column  4  the  ratio  of  scheduled  preparation  tame  to  the 
marks  obtainable. 
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TABLE  V 

RATIO  OF  MARKS  ON  PAPER  TO  PREPARATION  TIME 


Topic  Title 

Marks 

jo  of  jo  of 

School  Year  Marks 

Ratio 

Column  Numbers 

1 

2 

3 

4 

I  International 

Relationships 

33 

25$ 

19.9$ 

.80 

IIA  The  Totalitarian  States 
B  The  Democratic  States 

24 

54 

30$ 

47.0$ 

1.60 

III  Commonwealth  Problems 

4 

20$ 

2.5$ 

0.13 

IV  Canadian  Problems 

A  External  Affairs 

B  Internal  Affairs 

25 

8 

25  $ 

19.0$ 

0.76 

Current  Events 

9 

(2.5$) 

5.4$ 

i 

(0.21) 

Abilitv  to  Interpret 

9 

- 

5A% 

- 

The  program  of  studies  does  not  specify  any  time 
allottment  fo  r  current  events.  This  topic  must  be  taken  up 
in  class  as  occasion  demands.  The  department  does  suggest, 
however,  that  one  period  per  week  be  devoted  to  this  topic. 

One  period  per  week  amounts  to  one-fortieth  of  the  school  year. 
I  have  therefore  placed  in  parentheses  the  corresponding  per¬ 
centage  (2.5)  and  the  resulting  ratio,  (0.21). 

This  summary  indicates  that  Topic  II  was  unduly 
weighted.  The  time  suggested  by  the  regulations  for  tne 
study  of  this  topic  is  twelve  weeks,  or  30  per  cent 
of  the  school  year.  Its  rating  on  the  test 
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is  46  per  cent  of  the  total  marks.  Its  ratio  works  out 
to  1.6,  whereas  the  ratio  for  no  other  question  nearly 
approaches  1. 

Qn  the  other  hand,  Topic  III  is  unduly  slighted. 
Although  the  outline  of  the  course  suggests  it  be  given 
a  period  of  eight  weeks,  or  one-fifth  the  school  year, 
on  the  test  it  rated  a  mere  4  marks,  or  one  forty-second 
of  the  total  raw  score,  and  has  a  ratio  of  0.13.^ 

Although  the  study  of  current  events  might 
reasonably  be  expected  to  include  a  consideration  of 
underlying  causes,  the  items  in  current  events  were 
confined  to  personalities  and  place  names  only.  There 
was  no  attempt  to  test  for  an  understanding  of  any  of 
the  forces  that  motivate  the  behaviour  of  men  and 
nations. 

9 

We  might  conclude  from  a  study  of  the  Table  that 
the  test  did  not  give  a  very  thorough  sampling  of  the 
course.  In  the  older  types  of  test  a  thorough  sampling  was 
not  considered  an  important  factor.  If  the  student  showed 
an  adequate  knowledge  of  the  sections  of  the  course  tested 
it  was  assumed  that  he  possessed  a  similar  knowledge  of  the 
sections  not  covered  by  the  test.  Today,  however,  when 
educators  are  striving  to  encourage  and  develop  the  special 
interests  of  the  student  it  would  possibly  be  more  satisfac¬ 
tory  to  both  student  and  teacher  if  each  topic  were  given 
its  fair  proportion  of  marks  on  the  test. _ _ _ _ 

Ilf  the  percentage  of  marks  obtainable  on  any  one 
topic  were  the  same  as  the  percentage  of  time  t 
allowed  for  its  preparation,  the  resulting  ratio 
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CHAPTER  VI 
THE  ENGLISH  SCORE 


It  was  at  first  intended  by  the  Department  of 
Education  to  divide  the  final  percentage  marks  on  the 
1940  paper  as  follows: 

Social  Studies,  70 % 

English  30% 

The  marking,  however,  proved  that  30%  constituted 
an  excessive  weighting  because  of  the  high  English  scores 
obtained.  It  was  decided,  finally,  to  add  to  the  trans¬ 
muted  Social  Studies  score  (see  Appendix  2)  one-half  of 
the  English  score.  The  sum  of  the  two  would  constitute 
the  net  or  final  score. 

English  was  marked  on  Question  I  only.  The 
schedule  is  shown  in  Appendix  2. 

The  issue  in  respect  of  the  English  component 
becomes  critical  at  the  passing-failing  point,  i.e,  near 
the  50  per  cent  net  score.  An  examination  of  the  315 
cases  shows  that  27  candidates  were  lifted  from  failure 
to  pass  on  the  strength  of  their  English  scores.  That  is 
to  say,  they  made  less  than  a  pass  mark  on  Social  Studies, 
but  were  passed  by  virtue  of  relatively  high  marks  in 
English.  The  following  illustrations  will  serve  to 
make  the  issue  clearer. 
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Candidate  number  336  presents  the  following 

record: 

Social  Studies  transmuted  score,  38.  This 
would  give  him  a  percentage  score  of  roughly  45  on 
the  basis  of  Social  Studies  alone.  (Failure.)  His 
mark  on  English,  however,  was  exceptionally  high,  viz., 

27.  This  mark  allows  him  to  pass  with  a  net  score 
of  51. 

By  way  of  comparison  let  us  consider  his 
immediate  neighbor  who  presents  the  following  record: 

Social  Studies  transmuted  score,  37;  English 
Score^,  25;  net  score,  49 Jo.  a  single  mark  short  of  the 
required  pass  mark  of  50  fo  required  for  matriculation. 

The  figure.  No.  14,  that  follows,  illustrates 
the  distribution  of  marks  on  the  percentage  raw  score  in 
Social  Studies  3.  The  total  raw  score  was  changed  to 
a  percentage  basis  before  the  diagram  was  constructed. 
Suppose  a  student  wrote  a  perfect  paper,  his  raw  score 
would  be  130.  The  English  was  marked  on  a  basis  of  85 
per  cent  for  Social  Studies  and  15  per  cent  for  English. 

The  percentage  scores  in  Figure  14  represent  the  percentage 
of  the  total  raw  score  that  the  student  actually  obtained. 


1 

In  actual  practice  the  English  mark 
added  here  is  TT  12Tf  and  not  u12.5.“ 
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Figure  15  illustrates  the  distribution  of  marks  for 
the  English  scores.  As  an  aid  to  comparing  them,  these 
scores,  too,  were  changed  to  a  percentage  basis.  In 
Figure  16  I  have  placed  the  column  diagram  for  the 
total  percentage  raw  score  over  that  of  the  English 
percentage  score.  The  distribution  of  each  can  thus 
be  more  readily  obtained. 
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FEUCE/VTage  Scopes 

Figure  14 

Raw  Score'*'  for  the  Total  315  Cases. 
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Raw  Score  here  was  reduced  to 
a  percentage  basis. 
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Figure  15 

Percentage  Score  for  English. 
315  cases. 
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Figure  16. 

Comparison  of  Total  S.S.  Percentage 
Paw  Scores  with  English  Scores. 
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The  column  diagram  illustrating  the  distribution 
of  marks  for  the  raw  score  of  the  315  cases  shows  the 
distribution  to  be  nearly  normal.  The  diagram  illus¬ 
trating  the  distribution  of  English  marks  seems  to  be 
noticeably  weighted  on  the  right.  A  smooth  curve  super¬ 
imposed  over  it  will  be  positively  skewed. 

In  the  raw  scores^  for  the  total  number  of  cases 
we  find  that  54  per  cent  of  the  cases  made  50  per  cent 
or  over  (raw  score).  On  the  English  score  for  the  total 
number  of  cases  64  per  cent  of  the  cases  made  50  per  cent 
or  over. 

The  correlations  existing  between  the  English 
marks  and  the  Social  Studies  raw  score  were  worked  out. 
The  three  categories  of  students.  A,  B,  and  C,  were  run 
separately.  The  following  correlations  were  obtained: 

A.  175  cases,  r  =  +.1453  ±.0030 

B.  54  cases,  r  -  +.1220  i.0060 

C.  36  cases,  r  =  +.4040  +.0093 

It  might  seem  strange  at  first  sight  that  on 
two  such  closely  allied  subjects  as  English  and  Social 
Studies  there  should  appear  so  slight  a  positive  correl¬ 
ation.  My  own  feeling  in  the  matter,  by  way  of  explan¬ 
ation,  is  this:  It  is  true  that  those  who  do  well  on 

Social  Studies  do  well  on  English.  But  it  is  also  true 


1  Figure  14,  page  75 
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that  those  who  do  poorly  on  Social  Studies  may  also 
do  well  on  English.  Further,  in  this  case  the  Social 
Studies  is  tested  at  the  Grade  XII  level.  The  English, 

I  believe,  is  being  tested  at  the  Grade  VIII  level — 
punctuation,  spelling,  etc.  In  one  hundred  papers  ex¬ 
amined  at  random  it  was  found  that  79  had  suffered  by  the  lo 
loss  of  the  whole  15  marks  allowed  for  punctuation.  That 
is  to  say,  79  made  nothing  at  all  on  punctuation.  This 
loss  of  15  marks  yields  a  loss  of  4  on  the  net  score. 

This  result  naturally  raises  the  question  vi/hether  English 
should  be  marked  at  all  on  an  examination  of  this  type. 

Even  if  it  is  proved  desirable  that  English  should  be 
marked  on  selected  subjects,  I  believe  that  the  above 
result  shows  that  punctuation  is  weighted  rather  heavily. 

The  same  may  be  said  for  some  of  the  other  items  of  the 
English  score  card. 

It  is  reasonable,  too,  to  suppose  that  students 
of  foreign  extraction  would  suffer  most  heavily  on  a 
marking  technique  of  this  sort. 

In  any  case  the  whole  scheme  seems  to  fall 
short  of  its  avowed  objective.  In  no  other  consciously 
selective  process  in  our  every-day  affairs  is  a  nian's 
achievement  in  one  skill  "measured"  and  rated  by  his 
achievement  in  some  other  skill,  separate  and  distinct, 
even  though  closely  allied. 

If  English  is  to  be  marked  each  year  on  some 
other  selected  subject,  it  would  appear  reasonable 
that  the  resulting  score  should  be  added  to  his  English 
^ince  English  is  a  compulsory  subject  no 
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injustice  could  possibly  result  from  reporting  the 
resulting  mark  where  it  belongs. 

Nor  can  I  see  any  validity  in  the  argument 
that  this  off-side  English  score  must  be  utilized 
as  a  means  of  exerting  pressure  on  teachers  to 
teach  English  in  all  subjects.  The  fact  is  that 
English  marked  in  this  manner  must  always  remain  at 
the  Grade  VIII  level.  The  High  School  student  by 
the  time  he  has  reached  Grade  XII  has  in  a  great 
number  of  cases  learned  to  write  v/ithin  his  own 
capabilities.  Indeed,  it  sometimes  happens  that  the 
brightest  student, whose  vocabulary  is  growing  rap¬ 
idly  will  use;in  an  essay  of  this  sort,, a  greater 
number  of  words  he  cannot  spell  than  the  duller 
student  who  by  Grade  XII  has  retired  on  a  very 
comfortable  capital  of  everyday  words. 

Such  being  the  case  I  am  led  to  conclude 
that  yearly  marking  of  English  on  a  selected  paper 
other  than  English  itself  in  all  probability  will 
not  serve  to  exert  pressure  on  the  teacher  to  teach 
English  in  all  his  other  courses.  If  the  Department 
insists— and  rightly  so— that  English  must  be  taught 
in  all  courses,  it  would  appear  that  we  must  depend 
largely  upon  the  professional  integrity  of  the 
teacher  to  see  that  this  is  done. 
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CHAPTER  VII 
THE  THREE  CATEGORIES 


The  marks  of  305  cases  were  grouped  under 
their  respective  categories  of  A,  B  and  C,  corresponding 
to  the  placements'*"  at  the  end  of  Grade  IX.  A  frequency 
table  was  drawn  up  to  show  the  distribution  of  the  raw 

9 

scores  in  each  category  and  a  column  diagram  illus¬ 
trating  the  distribution  for  each  category  was  then 
constructed. 

Other  statistical  data  essential  to  an 
adequate  understanding  of  the  achievement  of  each  of 
these  categories  were  calculated,  and  it  may  be  advis¬ 
able  tdj  this  point  to  offer  a  word  of  explanation 
concerning  the  statistical  measures  that  comprise  these 
data. 

The  mean  simply  refers  to  the  ordinary  average; 
the  median  represents  the  middlemost  score  after  the 
series  has  been  arranged  from  lowest  to  highest.  It 
is  such  that  there  are  as  many  scores  above  it  as 
there  are  scores  below  it.  The  mo de  is  the  scale 
value  at  which  the  frequency  curve  is  the  highest. 

It  may  be  described  as  the  most  "stylish7'  mark.  All 
three  of  these  forms,  viz.,  mean,  median  and  mode,  are 
known  as  measures  of  central  tendency. 

The  range  is  the  difference  between  the 

- - Q1 

t  See  p.  10  above.  _  .  .  .  - 

2  The  information  supplied  by  at  diagram  of 
this  type  is  explained  on.  p.29,  above. 
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highest  and  lowest  scores.  I  have  set  down  here 
the  range  limits  as  being  more  comprehensive  to  the 
average  reader.  represents  the  25th  percentile, 
or  lower  quartile.  This  means  that  25  per  cent  or 
one  quarter  of  all  the  scores  fall  at  or  below  this 
point.  Both  these  measures,  viz.,  range  and  lower 
quartile,  indicate  the  degree  of  dispersion  or 
scatter  of  the  scores. 

The  measures  of  central  tendency  were 
calculated  for  the  A  category  and  found  to  be  as 
follows:  Mean,  78.8;  median  77.2;  mode,  77.0. 

The  measures  of  dispersion  calculated 
resulted  as  follows:  Bange  76  (30-115);  first 
quartile  61.3;  standard  deviation  16.76;  percentage 
passed,  79.0. 

There  were  175  cases  in  the  A  category. 


,  . 

.  ! 

vi  .iio.f  r\  oo  -3T  ...  i  9l  .  31  -  ..  d" 

5  ■  1/  1  1 

■ 

..  , 

:  [0  '  .  ■  :  $  XI B  ■ 

.  .  . 

*  0.  1  •  3 3"  .  i  t  ■ 

•  ©  •  VC;  ‘  3i  O  '  ‘157  :.-3 .  8S1J  V 

«  ;  .  i  ;  ♦  t  : 

.  .  .  .  ....  0.  C  - 

;  :  ; 

;  ;  . 

0  ;  '  •; '  ©-1  ..  _  .  ‘ 


83. 


Figure  15 . 

Distribution  of  Scores  for  ,TAn  Category. 
175  cases. 
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In  the  TtB"  category  there  were  94  cases. 

The  tabulation  of  the  raw  score  yield  s  the  following 
statistical  data: 

Mean,  60.0;  median  60.7,  and  mode  62.5. 

In  the  measures  of  dispersion  c  alculated, 
the  following  results  were  found:  standard  deviation, 
15.0;  range,  72;  first  quart ile,  51.0. 

In  the  94  cases  of  B*s  considered,  42.5 
per  cent  achieved  the  minimum  matriculation  requirement 
of  50  per  cent  or  over. 
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Figure  16 

Distribution  of  Scores  for 
Category.  94  cases. 
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In  the  "C”  category  there  were  36  cases. 

The  frequency  table  based  on  the  distribution  of 
raw  scores  in  this  category  gives  the  following 
measures:  mean,  63;  median  53.3;  and  a  mode  of 
65.  This  distribution  as  seen  from  the  accompany¬ 
ing  diagram,  proved  to  be  almost  bi-modal,  with 
the  lower  mode  at  45.  The  range  is  40  (35-84); 
the  standard  deviation,  11.5,  and  the  first  quartile 
is  41. 

Of  the  36  cases  examined  in  this  category, 

30.6  per  cent  achieved  a  pass  mark  of  50  per  cent 
or  higher. 
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Distribution  of  Scores  for  nCTt 
Category.  36  cases. 
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To  give  a  more  complete  understanding  of  It  he 
relative  achievement  in  these  three  categories  I 
have  summarized  in  the  Table  which  follows  the  dat® 
referred  to  above. 


TABLE  VI 

DATA  OF  THE  THREE  CATEGORIES 
(S.S.3  Raw  Score) 


A's 

B's 

C's 

Mean 

78.8 

60.0 

63 

Median 

77.2 

60.7 

53.3 

Mo  de 

77.0 

62.5 

45  $  65 

Range  Limits 

30-115 

27-99 

35-84 

h 

61.0 

51.0 

41.0 

No.  of  Cases 

175 

94 

36 

Percentage  Passed 

79.0 

42.5 

30.6 

Perhaps  it  v/ould  be  well 

to  note  here  that 

the  average  reader  will 

be  most  interested  in  the 

last  item  of  the  above 

table  ,  and 

this  item 

I  have 

illustrated  by  the  three  bar  graphs  which  comprise 
the  following  figure. 
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Figure  18 

Bar  Graphs  Showing  Percentage  Passed 
in  Each  Category. 
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50/c  or  over. 
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All  the  data  involving  the  "A"  group  indi¬ 
cates  that  the  grading  at  the  end  of  Grade  IX  was 
a  justifiable  procedure.  indeed,  this  same  observation 
may  be  made  for  each  of  the  two  remaining  categories. 

In  the  r,Bn  category,  the  number  which  passed 
is  not  as  large  as  we  might  expect  in  view  of  the  fact 
that  almost  7-  per  cent  of  these  same  students  passed 
in  the  Social  Studies  of  Grade  IX. 

In  collecting  the  original  data  for  this  inves¬ 
tigation,  the  cases  were  chosen  at  raidom  from  the 
departmental  files , — rather ,  1  should  say  that  the 
very  great  percentage  of  my  cases  were  so  chosen — but 
it  was  found  that  this  method  did  not  give  a  suffic¬ 
iently  large  class  of  Cfs  for  an  adequate  treatment 
of  this  group.  In  a  number  of  cases  it  proved  nec¬ 
essary  to  go  back  over  the  files  for  the  purpose  of 
selecting  Cfs  only.  Even  with  this  procedure  only 
36  cases  of  Cfs  resulted.  This  leads  me  to  believe 
that  the  Cfs  throughout  the  Province  constitute  a 
smaller  group  thah  is  generally  supposed.  However, 
the  exact  number  in  each  category  for  the  whole 
Province  was  not  readily  available  at  that  t ime  and 
the  above  supposition  must  only  be  accepted  as  such. 
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There  is  the  further  factor  to  be  considered, 
viz.,  that  the  "C"  category  would  suffer  most  severely 
from  the  "culling"  process  that  takes  place  in  the  years 
from  Grade  IX  to  Grade  XII,  and  possibly  this  factor 
more  than  any  other  would  account  for  the  paucity  of 
C’s  in  Grade  XII. 

In  any  case,  the  group  showed  a  considerable 
improvement  in  the  three  years  between  the  Grade  IX  and 
Grade  XII  examinations.  Whereas  in  Grade  IX  only  16 
per  cent  of  the  C's  passed  in  Social  Studies,  there  was 
a  relatively  large  percentage  of  passes,  30.6  per  cent, 
in  Social  Studies  3. 

I  might  pount  out  here  that  much  progress  eminently 
justifies  the  "C"  student  "holding  on”  till  the  end  of 
Grade  XII. 

The  information  supplied  by  the  preceding  pages 
may  prove  misleading  if  we  do  not  take  into  consideration 
the  fact  that  under  the  revised  course  of  studies  there 
is  more  than  one  kind  of  "pass." 

Taking  the  matriculation  pass  mark  of  50  per 
cent,  the  relative  standings  were  as  follows: 

Per  cent  passed:  A  -  79 Jo\  B  -  43.5 aJo\  C  -  30.6 fo. 

Under  the  revised  course  a  mark  of  40  per  cent  in  this 
Course  gives  the  student  five  credits.  If  we  look  at 
the  "revised"  pass  mark,  then  our  relative 
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standings  appear  as  follows: 

Percent  passed  (for  credit):  A  -  95;  B  -  72.6,  C  -  44.4. 

This  new  "pass  mark"  allows  the  Cfs  -  and  indeed 
students  of  other  categories  as  well  -  to  have  a  nww 
low  aim.  Furthermore,  in  some  of  our  larger  schools 
the  "C"  group  is  a  class  set  apart  and  marked  for  a 
sort  of  specialization  in  the  manual  arts  and  other 
non-academic  options.  They  are  therefore  slighted 
to  some  extent  in  an  academic  way  and  it  is  just  pee  s- 
ible  that  comparisons  with  other  groups  of  the  kind  h©re 
set  down  do  not  do  them  full  justice. 
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CHAPTER  VIII 


OTHER  STATISTICAL  COMPARISONS 
It  was  thought  advisable  to  take  our  315  cases  and 
investigate  their  records  in  the  Social  Studies  of  Crade  IX 
and  in  Social  Studies  1  and  2.  We  shall  thus  be  able  to 
see  how  each  of  our  cases  fared  in  the  other  three  courses, 
and  compare,  when  that  is  possible,  the  test  standards  that 
seem  to  exist  in  each  of  the  four  courses  in  Social  Studies. 

The  Social  Studies  net  scores  in  Grade  IX  yield 
the  following  statistical  data.  The  305  cases  show  a 
range  of  66(22-88).  The  mean  is  57  and  the  mode  55.  The 
median  score  is  56.1.  The  first  quart ile  falls  at  50.2. 
Though  the  range  extends  to  an  upper  limit  of  88,  only 
five  subjects  achieved  a  mark/%fy where  in  the  80’s. 

Of  67  students  who  failed  in  Social  Studies  of  Grade 
IX,  23  passed  in  Grade  XII  Social  Studies.  In  the  !rCn  group, 
30  out  of  36  subjects  -  83.3J&  -  failed,  and  of  this  large 
number  failing  the  Social  Studies  of  Grade  IX,  only  seven 
passed  in  the  Social  Studies  of  Grade  XII. 

In  this  connection  we  must  remember  that  quite  often 
it  is  the  Social  Studies  in  Grade  IX  that  places  a  student 
in  the  ^G,f  category.  When  this  is  so,  we  might  reasonably 
expect  the  student  to  continue  weak  in  this  subject  through¬ 
out  his  High  School  career. 
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The  correlation  between  the  Grade  IX  scores 
in  Social  Studies  and  the  corresponding  raw  scores  on 
the  Social  Studies  of  Grade  XII  is  +'.7100.  This  high 
positive  correlation  indicates  that  the  same  or  very 
similar  types  of  achievement  are  being  measured  in 
Grades  IX  and  XII.  If  my  supposition  "above^  is  correct, 
viz.,  that  there  is  only  a  single  objective  being 
measured  to  any  extent,  the  high  positive  correlation 
would  be  readily  explained. 


Grade  X  lie  commended  Marks 
When  we  turn  to  the  recommended  marks  in 
Grade  X  we  find  that  the  range  is  very  greatly  reduced 
and  that  its  lower  limit  is  considerably  above  the 
lower  limit  of  the  usual  range  for  any  class  writing 
a  departmental  test  . 

This  restricted  range  is  in  fact  what  we  might 
well  expect  to  find.  The  bulk  of  the  subjects  are 
from  the  smaller  schools  and  in  dealing  with  smaller 
groups  of  students  the  tendency  is  to  shorten  the  range. 
Even  in  one  of  our  largest  city  High  Schools,  however, 
it  is  noted  that  in  the  recommended  marks  of  Grade  X 
no  mark  of  the  CTs  went  below  40  and  no  mark  of  the  A*s 
went  above  83.  In  another  large  city  school  it  is 
found  that  in  Grade  X  no  mark  falls  below  60. 
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See  p.67. 
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In  the  distribution  of  marks  in  Grade  X 
the  mean  is  66.5;  the  median  67;  and  the  mode  is 
65.  The  range  is  40-100  and  the  first  quartile  is 
located  at  56.3. 

The  correlation  between  the  Grade  X  recommended 
marks  and  the  raw  score  on  Social  studies  3  is 
+.6480.  It  would  appear  from  this  that  even  though 
the  recommended  scores  seem  to  be  the  result  of  closely 
controlled  marking,  the  marking  is  controlled  by  some 
generally  accepted  standard.  That  is  to  say,  that 
although  in  comparison  with  the  departmental  scores  the 
recommended  marks  seem  to  be  extremely  high,  the  teachers  do  , 
on  the  whole,  give  the  highest  marks  to  those  students  who 
do  eventually  prove  their  superiority  when  submitted  to  the 
more  severe  province-wide  standard. 

Grade  XI  Recommended  Marks. 

The  Grade  XI  recommended  marks  have  a  mean  of 
73.3  and  a  median  score  of  63.2.  The  range  is  40-90 
per  cent.  In  this  class  94  per  cent  of  the  cases 
made  50  per  cent  or  over,  or,  taking  50  per  cent  as 
the  pass  mark,  we  may  say  94  per  cent  passed- 
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In  Social  Studies  2,  of  course,  a  mark  of 
40  per  cent  allows  a  student  to  get  full  credit  for 
the  subject  and  go  on  to  the  work  of  Social  Studies  3. 
Considered  on  this  basis  the  Grade  XI  recommended 
marks  contain  no  failures  .  That  is  to  say,  there 
was  no  one  in  this  class  of  305  cases  who  made  under 
40  per  cent.  In  the  V!CTI  category  the  recommended 
marks  for  Grade  XI,  with  a  range  of  40-70,  have  a 
mean  of  54.3  per  cent. 

An  inspection  of  the  distribution  tables^ 
would  seem  to  indicate  that  there  is  a  wide  variation 
in  the  standards  of  various  schools. 

In  one  of  the  smaller  schools  (nWn  on  the 
distribution  table),  five  cases  picked  at  random 
show  a  range  of  60-70  in  the  recommended  marks  of 
Grade  XI.  The  same  net  scores  of  the  same  subjects 
in  Grade  XII  have  a  range  of  31-56.  Another  small 
school,  picked  at  random  ( 11  Zn  dn  the  Table),  has  a 
range  of  60-70  in  the  recommended  marks  of  Grade  XI, 
but  the  net  scores  of  Grade  XII  have  a  range  of  35-40. 
These  observations  I  believe  to  be  typicaL  of  a  fairly 
large  percentage  of  the  schools  recorded,  and  they 
give  rise  to  the  following  questions: 

- - - - 
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1.  Is  the  standard  teachers  set  for  them¬ 
selves  in  the  marking  of  Social  studies  2  lower 
than  that  set  by  the  department  for  Social  Studies 
1  and  Social  otudies  3? 

2.  Is  there  some  attempt  on  the  part  of 
teachers  to  measure  a  different  set  of  values 
than  those  measured  by  the  departmental  examin¬ 
ations! 

The  obvious  answer  to  Question  1  is  ”Yes,T, 
but  I  believe  in  fairness  to  the  teachers  we  must 
first  ask  ourselves  why  the  standard  appears  to  be 
lower,  and,  secondly,  give  some  consideration  to 
the  possible  answers  for  Question  2. 

V/ith  the  new  techniques  recommended  by  the 
department  for  teaching  the  Social  Studies  it  may, 
and  often  does,  happen  in  all  the  Grades,  that  diff¬ 
erent  schools  may  have  in  reality  very  different 
courses  in  Social  Studies.  A  teacher,  then,  testing 
achievement  in  knowledge  and  understanding  of  the 
course  taught  by  himself  will  in  the  very  nature  of 
the  case  have  a  different  standard  than  a  central 
examining  body  which  tries  to  measure  the  achieve¬ 
ment  in  all  the  courses  taught  by  all  the  teachers 
in  the  Province. 
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The  different  standard,  then,  I  believe  to 
be  unavoidable  and  not  of  itself  undesirable.  A 
possible  undesirable  feature,  however,  would  be  this 
suppose  a  teacher,  following  his  own  standards  of 
achievement,  ends  his  term  with  a  number  of  studaits 
havming  marks,  shall  we  say,  of  35.  A  neighboring 
teacher,  following  his  own  standards,  turns  out  a 
similar  number  of  students  with  marks  of  55.  Quite 
obviously,  the  students  who  were  submitted  to  the 
more  severe  standard  have  been  done  an  injustice. 

A  close  inspection  of  our  table  reveals  the  fact 
that  teachers  avoid  this  injustice  by  giving  no 
marks  under  40  per  cent.  It  is  understood,  of 
course,  that  for  practical  purposes  a  student 
making  a  Social  Studies  3  mark  of  55  has  no  advan¬ 
tage  over  the  student  making  40;  i.e.,  insofar  as 
the  credits  are  concerned. 

Considering  our  second  question,  I  believe 
that  it  is  quite  possible,  even  likely,  that  our 
teachers  are  making  an  honest  effort  to  measure 
values  other  than  those  measured  by  the  Department 
in  Social  Studies  3.  It  is  quite  noticeable  ,  too, 
that  the  teacher’s  recommended  marks  in  Grades  X 
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and  XI  have  a  higher  positive  correlation  with  the 
scores  of  Grade  IX  than  with  the  scores  of  Grade  XII. 
This  higher  correlation  I  believe  to  be  a  result  of 
an  attempt  on  the  part  of  the  teachers  to  evaluate 
achievement  in  some  of  the  objectives  of  the 
revised  course  that  have  been  so  far  untouched  by 
the  official  test  of  Grade  XII. 


Summary  of  This  Chapter 

For  the  reader  to  whom  figures  sp  eak  louder 

than  words,  I  have  summarized  the  statist!  cal  data 

of  this  chapter  into  the  table  which  follows;  and  for 

the  reader  who  prefers  his  facts  decently  clothed  in 

the  mantle  of  deduction  I  have  taken  the  liberty  of 

adding  a  word,  of  explanation. 

The  statistical  measures  reported  in  the 

following  table,  with  the  exceptions  to  be  noted, 

1 

have  all  been  referred  to  above.  represents 

the  third  quartile.  It  is  the  point  in  the  distri¬ 
bution  such  that  75  per  cent  of  all  the  cases  lie  at 
or  oelow  tfasrfr  it.  Q  is  the  quartile  deviation.  It 
is  calculated  from  the  following  formula:  Q  -  ^ — 2“^  *’ 

and  actually  measures  the  average  distance  of  the  two 
quartileg  points,  Qn  and  Qg  from  the  median. 
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The  standard  deviation  ^  is  possibly  the 
most  significant  of  the  measures  of  dispersion  used 
in  this  table  and  gives  a  fair  idea  of  the  degree  of 
dispersion  or  scatter  of  the  scores  about  the  central 
tendency . 


TABLE  VII 

SUMAHT  OF  STATISTICAL  BATA 


TT 

±A 

X 

XI 

in  * 

lie  an 

57 

69.5 

73.3 

52.9 

Median 

56.1 

67.0 

63.2 

51.6 

Mode 

55 

65 

65 

65 

Standard  Deviation 

10.0 

11.5 

10.5 

11.41 

Lange  Limits 

££-88 

40-100 

40-90 

15-95 

i — 1 

C2? 

50.2 

56.3 

51.7 

45 

q3 

61.4 

71.0 

71.5 

60.8 

Q 

5.6 

7.3 

9.9 

7.9 

Percentage  Passed 

'/Qfa 

95.8^ 

94 $ 

6Zf, 

^  This  measure  is  not  readily  reducible  to  a 
verbal  definition;  for  a  complete  under¬ 
standing  the  reader  is  referred  to  the 
’’'Fundamentals  of  Statistics,''  by  L.L. 
Thurstone,  p.101. 

aBased  on  Net  Scores. 
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In  the  abo^e  table  the  calculated  measures, 
for  the  most  part,  follow  quite  closely  the  normal 
distribution  and  as  such  require  no  special  comment. 
The  data  for  Grades  IX  and  XII  are  based  on  depart¬ 
mental  examinations  and  those  for  Grades  X  and  XI 
are  based  on  the  teachers’  recommended  marks.  Here 
it  is  significant  to  note  that  the  departmental 
examinations  result,  quite  consistently,  in  lower 
measures  of  central  tendency.  The  range  limitts 
show  that  teachers  consistently  refuse  to  give  a 
final  mark  below  40  per  cent,  but  whether  this  is 
the  result  of  sense  or  sentiment — the  sentiment  of 
teachers  or  the  sense  of  the  revised  course,  I  am 
unable  to  say. 

The  percentage  passed  in  the  recommended 
marks,  as  well  as  a  comparison  of  the  respective 
modes,  would  indicate  that  teachers  are  evolving 
their  own  standards  of  achievement,  inconsistent 
as  yet  with  those  of  the  department,  but  consistent 
within  the  teaching'  profession  and  from  grade  to 
grade . 
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CHAPTER  IX 


CONCLUSIONS  AND  SUGGESTIONS. 

A.  Conclusions 

In  the  daikness  of  the  present  hour  when 
civilization  itself  is  straining  every  nerve  and 
sinew  to  retain  the  priceless  privilege  of  change, 
he  who  dons  the  armour  of  reform  should  know  the 
windmills  from  the  giants.  In  the  restless  realm 
of  Education  is  it  doubly  true  that  the/reforming 
knight -errant  must  tread  warily  lest  he  find  himself 
in  mortal  combat  with  the  harmless  windmill  while 
the  dreaded  giant  escapes. 

I  must  remind  the  reader,  too,  that  this  is 
a  minor  study  and  any  conclusions  drawn  there  form 
must  as  a  consequence  be  accorded  minor  importance. 

On  the  other  hand,  the  nature  of  the  study  demands 
that  such  conclusions  as  do  aris  e  in  the  mind  of 
the  writer  must  be  expressed.  The  res.  der  isfree 
to  modify  these  conclusions  to  his  heart's  desire, 
or  indeed  to  draw  any  number  of  different  conclusions. 

The  Roman  numerals  in  t he  lift -hand  margin 
refer  to  the  specific  chapters  whence  my  conclusions 
are  derived. 
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I.  1.  Measurement  has  always  held  an  important 
place  in  the  educative  process. 

2:.  The  importance  of  educational  measurement 
has  become  so  great  that  it  must  be  considered 
an  integral  part  of  the  educational  program, 
and  not  a  mere  annual  rite  to  round  off  the 
school  year. 

II.  3.  Individual  schools  vary  greatly  in  the 
results  obtained  on  the  Social  Studies  3 
examinations.  In  a  number  of  cases  the  re¬ 
sults  were  so  poor  that  I  am  led  to  believe 
that  either  the  tea cher  concerned  misinter¬ 
preted  the  course  or  consciously  prep  a  red  his 
students  for  a  different  type  of  examinations 
4.  The  results  show  no  significant  variaticns 
between  the  different  types  of  schools  studied. 
Good  and  bad  results  seem  evenly  distributed 
among  the  schools  of  every  type  studied. 

III. 5.  Question  number  1(c)  served  no  useful  pur¬ 
pose  as  a  test  item.  It  possibly  served  a 
useful  purpose  as  a  !t feeler”  to  decide  the 
need  for  incorporating  such  material  into  the 
course. 

6.  The  questions  most  readily  associated  with 
their  respective  topics  in  the  course  outline 
were  anwered  best  by  the  students. 
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7.  None  of  the  test  items  was  highly  efficient  in 
discriminating  between  T,those  who  know  and  those 
who  do  not  know.”  The  index  of  discrimination  is 
consistently  low  and  indicates  that  the  function  of 
discrimination  was  not  adequately  performed  by  the 
test. 

8.  An  analysis  of  Question  III  indicates  that  a 
relatively  large  number  of  our  Grade  III  students, 
approximately  twenty  per  cent  ,  have  not  developed 
beyond  the  bowler*  stage.  At  least  one  'howler* 
was  found  on  that  percentage  of  papers. 

9.  The  C*s  give  a  better  account  of  themselves  on 
Current  Events  than  on  any  other  topic  of  the  course. 

10.  The  less  important  items  of  any  topic  function 
better  as  a  means  of  discriminating  between  the  best 
and  poorest  students  then  do  the  more  important  items 
of  the  same  topic. 

IV.  12.  When  examiners,  i.e.,  those  who  set  the  paper, 
depart  from  the  outline  of  the  course  and  test  for 
information  not  specifically  indicated  in  the  outline, 
students  seek  refuge  in  other  options  and  thus  defeat 
whatever  purpose  the  examiners  had  in  mind. 
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13.  Where  a  questions  consists  of  a  number  of 
sub-questions,  in  justice  to  the  student  all 
these  sub-questions  should  deal  with  the  same 
topic  of  the  course. 

¥.  14.  A  sufficient  effort  was  not  made  on  this 

test  paper  to  defeat  the  *c rammer.1^  This  is 
merely  another  way  of  saying  that  the  test 
followed  too  closely  the  patternof  the  old 
History  4  test. 

15.  A  concomitant  conclusion  to  the  above  is 
that  the  test  should  not  favour  those  students 
whose  study  is  confined  to  either  the  basic  test  , 
(McAuliffe),  or  the  Social  Studies  3  manual,  or 
both. 

16.  Closely  associated  with  the  above  is  the 
conclusion  that  the  test  does  not  favour  the 
student  whose  preparation  consisted  of  extensive 
reading  from  the  indicated  references. 

17.  One  topic  of  the  outline,  viz..  Topic  II, 

was  unduly  weighted  in  the  sampling,  to  the  neglect 
of  others.  It  is  claimed  by  some  teachers  that  this 
is  not  an  important  consideration;  but  I  believe  it 
would  be  more  satisfactory  to  students  and  teachers 

9 

alike  if  the  examination  values  corresponded  more 
closely  to  the  suggested  preparation  time. 

IT he  reader  is  referred  to  p.58,  above. 

Values"  is  used  here  in  the  sen$e  in 
which  it  is  used  in  the  lift-hand 
margin  of  the  examination  paper. 
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18.  The  ability  to  interpret  historical  material 
is  an  important  aspect  of  the  course  and  claims 
a  more  important  rating  on  the  test.  The  attempt 
made  to  measure  it,  viz..,  in  Question  XIII, 
appears  inadequate  insofar  as  the  marking  of  this 
question  was  of  necessity  highly  subjective. 

VI.  10.  It  seems  unfair  that  a  studentfe  ability  in 
English  should  determine  his  standing  in  Social 
Studies.  The  abilities  involved  are  separate  ard 
distinct  and  any  attempt  to  combine  them  for  the 
purpose  of  measuring  achievement  in  each  offers 
so  many  difficulties  that  an  injustice  to  certain 
types  of  students  is  bound  to  result. 

20.  It  does  seem  to  the  writer  desirable  that 
English  should  play  an  important  role  in  the 
presentation  of  all  courses,  but  that  this 
result  might  be  achieved  by  relying  upon  the 
professional  integrity  of  the  individual  teacher 
to  see  that  the  Department’s  wishes  are  carried 
out . 

VII. 21  Each  of  the  three  categories  achieved  results 
that  justify  their  relative  grading  at  the  and 
of  Grade  IX. 
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22.  The  C's  considered  as  a  class  seem  at  first 
glance  to  have  achieved  more  progress  in  the 
years  from  C-rade  IX  to  Grade  XII  than  did  the 
B?s.  However,  this  result  is  no  doubt  due  to 
the  fact  that  a  large  percentage  of  the  C’s  would 
be  culled  out  before  reaching  Grade  XII,  and 
those  remaining  would  be  a  somewhat  selected 
group  in  this  Category. 

VIII  23.  Students  who  fail  in  the  Social  Studies 
of  Grade  IX  appear  to  have  a  fair  chance  of 
passing  the  Social  Studies  of  Grade  XII. 

24.  Although  the  Grade  X  and  Grade  XI  recommended 
marks  are  much  higher  than  the  corresponding  de¬ 
partmental  marks  in  Grades  IX  and  XII,  the  high 
correlations  obtained  indicate  that  the  teachers’ 
marks  do  succeed  in  giving  the  student  his  proper 
rank,  or  relative  position,  in  the  class. 

25.  There  is  the  possibility  that  teachers  are 
in  some  degree  attempting  to  measure  some  of 
the  objectives  of  the  revised  course.  As  yet 

we  have  no  adequate  testing  t echnique  to  measure 
these  objectives,  and  the  attempt  to  measure 
them/only  find  expression  in  higher  marks. 
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B.  Suggesti  ons  for  Improvement. 


It  seems  possible  that  some  improvement  in 
our  official  testing  program  might  be  achieved  if 
there  were  a  definite  effort  to  measure  more  of  the 
outcomes  of  Social  Studies  instruction.  The  paper 
that  forms  the  basis  for  this  study  is  divided  into 
three  parts,  viz.,  A,  B  and  C.  Some  such  division, 
slightly  extended,  would  serve  admirably  for  the 
suggestion  I  have  in  mind.  The  basic  objective 
wouM  still  remain  a  body  of  information.  This  ob¬ 
jective  would  be  tested  in  Part  A.  By  using  the 
objective  test  technique  the  whole  course  could  be 
sampled  very  efficiently  in  less  than  one-half  the 
time  demanded  by  the  present  essay-type  paper. 

Suppose  we  then  take  a  limited  number  of  objectives 
from  the  suggested  list,'*’  and  attempt  to  measure  the 
achievement  in  each.  For  purposes  of  illustration 
let  us  take  the  first  three  referred  to  above.  These 
objectives,  I  believe,  oould  be  adequately  tested  by 
the  procedures  developed  by  Marion  Clark  for  the 
investigation  carried  on  by  the  Commission  on  the 
Social  Studies  in  the  Schools,  sponsored  by  the 
American  Historical  Association. 


1 

2 


See  pages  63  and  64  above. 
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These  objectives  would  be  tested  by  parts 
B,  G  and  D  of  our  proposed  paper. 

"Inasmuch  as  coherent  and  cogent  composition 
is  still  one  of  the  most  widely  used,  as  it  is  one  of  the 
most  valuable  skills  in  social  science,  it  wauld  seem 
essential  to  continue  to  use  the  essay-type  examination 
if  for  no  other  reason  than  to  afford  practice  in  this 
skill. In  view  of  the  fact  that  the  experts  in  the 
Social  Studies  field  seemed  to  be  in  agreement  on  this 
aspect  of  our  problem  it  must  not  be  neglected  in  a 
proposed  revision  of  the  testing  program.  An  effort 
to  measure  this  skill  would  (Emprise  part  E  of  our  paper. 
Since  only  a  small  percentage  of  our  s  econdary  school 
graduates  will  ever  have  need  of  preparing  a  longer 
type  of  composition  on  any  of  the  topics  concerned, 
it  would  seem  to  be  the  better  plan  to  measure  the 
above-mentioned  skill  by  a  series  of  paragraphs.  This 
would  save  time  and  offer  a  wider  scope  for  this 
aspect  of  the  test. 

The  above-mentioned  suggestions,  though 
sketched  of  necessity  in  a  very  general  way,  indicate, 

I  believe,  a  direction  that  offers  the  possibility 
for  some  worthwhile  improvement. 
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APPENDIX  1. 

DISTRIBUTION  TABLE  UPON  WHICH  THIS  STUDY 
IS  BASED. 


School 

Paper 

No. 

Cat. 

IX 

s.st. 

X 

s.st. 

XI 

s.st. 

R.S. 

XII 

I.S.  Eng, 

B.S. 

A 

59 

C 

31 

55 

40 

49 

29 

22 

40 

62 

C 

38 

---- 

50 

50 

51 

31 

16 

37 

64 

A 

50 

•u>  «a  TO 

55 

60 

56 

35 

21 

45 

72 

B 

33 

ASM 

50 

55 

61 

40 

15 

47 

81 

A 

49 

65 

60 

68 

45 

16 

53 

B 

183 

A 

62 

•»•<**  ■=» 

55 

65 

41 

24 

10 

29 

184 

C 

31 

»  s®  29 

46 

55 

36 

21 

3 

22 

188 

A 

61 

74 

85 

97 

68 

10 

73 

190 

A 

61 

•  tB  • 

85 

85 

73 

49 

6 

52 

191 

C 

50 

*»  3  (A 

67 

70 

74 

50 

7 

53 

C 

291 

A 

62 

e  = 

45 

50 

66 

44 

17 

52 

292 

A 

72 

75 

60 

85 

58 

6 

61 

294 

A 

51 

114 

40 

50 

70 

47 

23 

58 

295 

±S 

56 

85 

50 

50 

55 

35 

17 

43 

297 

A 

62 

111 

65 

70 

115 

81 

20 

91 

D 

334 

A 

58 

a  ss. 

55 

65 

52 

32 

22 

43 

335 

A 

66 

-  »  - 

65 

60 

58 

37 

25 

47 

336 

A 

&Q 

atea 

75 

80 

59 

38 

27 

51 

338 

A 

66 

55 

55 

67 

45 

21 

55 

339 

A 

62 

--- 

70 

70 

43 

25 

20 

35 

E 

1148 

A 

60 

55 

80 

76 

52 

24 

64 

1160 

B 

51 

«*  a*  ?*» 

60 

70 

33 

19 

22 

30 

1170 

A 

57 

coa 

80 

70 

80 

55 

5 

57 

1184 

A 

82 

75 

80 

77 

52 

11 

57 

1182 

B 

45 

50 

45 

51 

31 

17 

37 

1343 

A 

68 

--- 

55 

75 

63 

42 

18 

51 

1265 

B 

52 

93 

65 

70 

62 

41 

3 

42 

1276 

C 

44 

104 

54 

55 

57 

36 

6 

37 

1291 

b 

49 

104 

50 

55 

54 

34 

7 

37 

1300 

B 

55 

«*  imim 

60 

45 

41 

24 

19 

33 

1311 

A 

69 

65 

65 

71 

48 

18 

57 

1322 

B 

59 

*»  to 

65 

70 

90 

62 

24 

74 

1347 

A 

63 

*•  ”•  iM» 

70 

50 

77 

52 

20 

62 

Ill 


Paper 

No*  Cat. 

IX. 

s.st. 

I. ft. 

A, 

s.st. 

n. 

s.st. 

R.S. 

III  . 

T.S.  Eng* 

N.S 

1358  B 

55 

127 

60 

60 

50 

30 

15 

37 

1366  C 

42 

-  -  — 

50 

60 

27 

15 

17 

23 

1378  A 

79 

... 

85 

85 

65 

43 

3 

44 

1383  A 

64 

we  w*  ** 

85 

80 

67 

45 

26 

58 

139  4  B 

64 

... 

60 

70 

82 

56 

13 

62 

1402  A 

67 

-  «  - 

75 

75 

67 

45 

19 

54 

1409  B 

65 

55 

50 

62 

41 

23 

52 

1422  C 

37 

86 

60 

50 

61 

40 

5 

42 

1426  C 

49 

n  «  M 

60 

40 

48 

29 

15 

36 

1436  B 

61 

87 

60 

65 

69 

46 

13 

52 

1453  C 

38 

we  mi 

60 

55 

46 

27 

19 

36 

1467  C 

47 

60 

60 

63 

42 

18 

51 

577  A 

78 

130 

80 

70 

104 

73 

23 

84 

585  B 

54 

<s»  <ae  Mi 

65 

50 

57 

36 

8 

40 

601  A 

73 

OH*  3* 

65 

65 

79 

54 

15 

61 

611  A 

51 

65 

55 

99 

69 

21 

09 

623  A 

58 

60 

65 

81 

55 

14 

62 

6  36  A 

63 

... 

60 

65 

78 

53 

8 

57 

657  A 

67 

--^5 

55 

70 

74 

50 

12 

56 

666  A 

75 

M  <sa  ast 

75 

65 

78 

53 

14 

60 

675  A 

65 

33» 

70 

65 

70 

47 

18 

56 

686  A 

47 

... 

65 

55 

58 

37 

12 

43 

698  A 

66 

Mi  »  as* 

60 

70 

74 

50 

23 

61 

712  A 

55 

... 

70 

70 

111 

78 

17 

86 

726  A 

50 

M  Ml 

55 

55 

52 

32 

17 

40 

736  B 

45 

... 

60 

55 

99 

69 

19 

78 

748  B 

50 

55 

55 

45 

27 

20 

37 

764  A 

66 

... 

70 

60 

91 

63 

29 

77 

772  A 

74 

... 

50 

60 

79 

54 

13 

60 

775  A 

68 

... 

80 

75 

101 

71 

19 

80 

7  76  A 

48 

60 

50 

86 

59 

22 

70 

784  A 

63 

... 

55 

50 

82 

56 

19 

65 

788  A 

72 

»  s3  «S 

65 

55 

89 

61 

14 

68 

79  3  A 

56 

MMM 

80 

75 

88 

61 

15 

68 

798  A 

74 

•  ««« 

60 

75 

94 

65 

20 

75 

806  A 

73 

we  «*>  w« 

70 

65 

59 

38 

26 

51 

810  A 

59 

70 

80 

71 

48 

18 

57 

1612  A 

59 

Wt 

70 

70 

91 

63 

24 

75 

1620  A 

65 

WWW 

60 

55 

106 

74 

22 

85 

1628  A 

64 

ww«| 

70 

65 

60 

39 

20 

47 

1638  A 

49 

■w  ew  we 

65 

60 

55 

35 

21 

45 

16  41  A 

69 

... 

70 

70 

87 

60 

26 

73 

16  42  C 

43 

... 

65 

50 

76 

52 

15 

59 

16  45  A 

54 

•  ww 

55 

50 

76 

40 

15 

47 

16  49  B 

50 

w*  «»  w 

55 

50 

68 

45 

15 

52 

1615  B 

55 

70 

65 

50 

54 

34 

21 

44 

1616  A 

50 

115 

65 

60 

78 

53 

22 

64 
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Cat* 

IX 

s.st. 

I  *Q. 

X 

s.st. 

XI 

s.st. 

B.S, 

xri 

T.S*  Eng. 

N  .S 

G 

1616 

A 

50 

115 

65 

60 

78 

53 

22 

64 

1621 

A 

51 

124 

75 

80 

75 

51 

21 

61 

1625 

B 

54 

109 

55 

55 

74 

50 

22 

61 

16  26 

A 

75 

117 

85 

80 

89 

61 

15 

68 

16  50 

A 

59 

96 

65 

60 

68 

45 

17 

53 

16  52 

B 

48 

103 

65 

55 

87 

60 

16 

68 

16  54 

A 

59 

114 

60 

50 

74 

50 

15 

57 

16  55 

B 

58 

109 

70 

70 

85 

58 

13 

64 

H 

1654 

B 

41 

106 

70 

60 

54 

34 

7 

37 

16  58 

A 

59 

101 

80 

60 

79 

54 

17 

62 

1667 

B 

72 

75 

70 

67 

45 

18 

54 

1672 

B 

50 

101 

60 

50 

63 

42 

7 

45 

1675 

C 

47 

102 

60 

50 

48 

29 

13 

35 

1675 

C 

45 

102 

60 

45 

45 

27 

2 

28 

1680 

A 

54 

107 

80 

70 

70 

47 

19 

56 

1682 

B 

54 

92 

75 

65 

37 

22 

15 

29 

1684 

A 

48 

112 

85 

85 

79 

54 

20 

64 

1688 

B 

56 

88 

60 

50 

53 

33 

11 

37 

1690 

A 

55 

122 

70 

55 

74 

50 

21 

60 

1691 

A 

67 

106 

70 

60 

91 

63 

15 

70 

1694 

A 

61 

108 

80 

70 

78 

53 

4 

55 

1698 

A 

72 

126 

70 

65 

67 

45 

19 

54 

1704 

A 

69 

111 

75 

75 

81 

55 

22 

66 

1707 

C 

44 

101 

75 

55 

54 

34 

17 

42 

1709 

A 

71 

111 

75 

70 

73 

49 

19 

58 

1711 

A 

66 

121 

85 

85 

185 

72 

17 

80 

1712 

A 

57 

106 

85 

65 

53 

33 

15 

40 

1715 

A 

56 

118 

85 

80 

109 

77 

28 

91 

I 

1869 

A 

48 

95 

70 

45 

66 

44 

24 

56 

186  5 

A 

63 

A 

80 

80 

94 

65 

a? 

73 

1858 

A 

46 

A 

85 

65 

56 

35 

23 

46 

1852 

B 

50 

B 

75 

65 

76 

52 

7 

55 

1847 

A 

70 

C 

85 

70 

50 

30 

16 

37 

1859 

A 

65 

A 

80 

70 

72 

48 

18 

57 

1834 

B 

46 

B 

85 

75 

65 

43 

21 

53 

1828 

B 

60 

-Cu, 

85 

80 

43 

25 

17 

33 

1824 

A 

80 

c 

85 

70 

77 

52 

7 

55 

1816 

B 

51 

c 

80 

70 

68 

45 

17 

53 

1812 

A 

88 

A 

75 

70 

71 

48 

18 
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Paper  IX±  X  XX 


No.  Cat. 

s.st. 

I  .d. 

s.st. 

s.st. 

R.S. 

T.S, 

Eng_«_ 

JL.s* 

1955 

A 

66 

65 

60 

59 

38 

19 

47 

1957 

B 

40 

nmma  tm 

58 

55 

59 

38 

17 

46 

196  4 

B 

54 

.... 

68 

45 

63 

42 

9 

46 

1975 

A 

58 

68 

65 

39 

23 

13 

29 

1983A 

A 

59 

... 

75 

70 

49 

29 

9 

33 

1993 

A 

50 

... 

78 

55 

75 

51 

22 

62 

1996 

A 

69 

74 

85 

74 

50 

14 

57 

2000 

A 

68 

... 

90 

85 

98 

68 

19 

77 

2006 

A 

61 

82 

80 

54 

34 

15 

41 

1995 

A 

63 

84 

80 

75 

51 

9 

55 

2309 

B 

63 

75 

65 

62 

41 

21 

51 

2305 

A 

58 

65 

65 

80 

55 

16 

63 

2302 

B 

51 

--- 

45 

65 

70 

47 

14 

54 

230 1A 

B 

42 

55 

60 

56 

35 

11 

40 

2295 

A 

51 

*■»  9B 

75 

75 

■  84 

58 

14 

65 

2293 

A 

61 

65 

85 

87 

60 

22 

©1 

2330 

A 

51 

m  m  «s 

60 

75 

67 

45 

14 

52 

2331 

A 

51 

MWM 

70 

75 

92 

64 

27 

27 

2333 

B 

55 

m«*ae 

70 

55 

59 

38 

23 

47 

2334 

A 

83 

MUM 

80 

85 

105 

74 

21 

84 

2335 

A 

67 

■»  <—  *9 

65 

70 

57 

36 

24 

47 

2336 

A 

64 

60 

75 

76 

52 

13 

58 

2338 

A 

57 

75 

80 

86 

59 

13 

65 

2339 

A 

58 

75 

80 

76 

52 

13 

58 

2341 

B 

63 

70 

65 

59 

38 

18 

47 

2480 

B 

36 

130 

62 

68 

97 

68 

23 

79 

2483 

A 

68 

.... 

80 

77 

96 

67 

19 

76 

2485 

A 

59 

5» 

58 

74 

93 

64 

21 

74 

2529 

A 

75 

«Bsa 

70 

65 

80 

55 

22 

66 

2537 
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51 

... 

70 

70 

50 

30 

18 

37 

2538 

A 

73 

. —  - 

80 

80 

75 

51 

22 

62 

2540 

A 

75 

70 

55 

64 

42 

21 

52 

2541 

A 

76 

--- 

80 

85 

95 

66 

21 

76 

2543 

B 

36 

60 

55 

57 

36 

12 

42 

2611 

A 

73 

mm  v  M 

90 

80 

63 

42 

25 

54 

26 18 

B 

53 

««<■ 

60 

70 

86 

59 

24 

71 

2581 

B 

55 

75 

65 

72 

48 

19 

57 

2582 

A 

53 

... 

70 

70 

84 

58 

11 

63 
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No. 
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APPENDIX  2. 


An  explanation  of  the  transmuted  score  may 
prove  helpful  to  the  reader.  It  is  a  score  in  terms 
of  the  standard  deviation  of  variability  of  the  scores 
of  a  distribution.  The  unit  of  variability  is  called 
a  standard  deviation  or  sigma.  It  is  necessary  to 
calculate  the  mean  and  the  standard  deviation.  Then 


the  following-  formula  is  used: 

10(1  -  Ml 

Sigma . 


T  “  50  + 


where  T  is  the  transmuted  score;  X  mmns  any  raw  point 
score  of  a  test;  M.  means  the  average  or  mean  of  the 
distribution.  Sigma,  or  standard  deviation,  is  the 
square  root  of  the  sum  of  the  squares.  By  using  50  the 
average  T-score  will  be  50. 

E.G-. ,  we  shall  estimate  ^  these  measures  to 
be  as  follows:  Sean  =  standard  Deviation  =  16. 

If  we  take  a  raw  score  of  74  our  formula  works  out  thus: 


T  - 


so-,- Mnni) 

Sigma 

80 

50  ^  16 


50 


10(8) 

16 


The  measures  substituted  in  this 
formula  are  for  illustration  and 
do  not  correspond  to  the  actus  1. 
measures  on  which  the  T-scores  in 
this  study  are  derived. 
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Reduced  to  its  ultimate  significance,  the 
transmuted  score  simply  means  that  instead  of  being 
judged  by  an  arbitrary  standard  of  50  per  cent,  the 
student  is  judged  on  the  standard  of  achievement 
actually  existing  among  his  fellow  students  throughout 
the  Province.  It  does  away  with  the  injustices  encountered 
under  the  previous  system  of  marking,  where  the  difficulty 
of  the  paper  varied  greatly  from  year  to  year. 

The  following  columns  show  how  the  T-s cores s 
shown  in  the  Distribution  Table  (Appendix  l)  compare  with 


the  corresponding  raw  scores: 
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Evaluation  of  English  on  selected  paper. 


Cancel  marks  according  to  the  score  card. 


